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ABSTRACT ' - 

AS part of the 1977 British Coluatia Batheaatics 
Assessa^entr over 100,000 students froa Grade*? 4^' 8, and 12 were given 
tests designed to aeasure aastery of a liaited nuaber of iaportant 
natheaatical skills and concepts. Approxiaately 3,500 teachers of. 
■atheaatics at seven different, grade level? coapleted coaprehensive 
qutetionnaires dealing with aspects of aatheaatics instruction in the 
prf^ince. This report is one of a four-part series and discusses th^ 
Stfld^nt Test phase pf the project. It contains a detailed exposition 
of the results, interpretation, and recoaaendations based on the 
student tests as Well as th^ process of identifying the specific' 
concepts and skills that were assessed. In addition to this report, a 
Suaaacy Report gives the highlights of the entire project^ Bepirt 
Nuaber 2 gives a detailed discussion af the Teacher Questionnaire 
phase, and Beport Huaber 3 gives a review of the itaas and dati ftoa 
both the Student Tests and Teacher .Questionnaire.. J(iyi)^ 
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In the spxi-ng of 1977, ctudeQts enrolle'd in Grades 4, 8-> and 12 in 
the^ public schools of the province of British Columbia took part in the 
first Assessment of Student Learnings in flathematics. conducted 'hy the 
Learning Assessment Branch of the Ministry of Education. During the same 
period, apt>roximately 3500 teachers of mathematics at seven, different 
grade levels completed a comprehensive questionnaire dealing with numer- 
ous aspects of the methods and materials used in the teaching of mathema- 
tics in the province. ' , • ' ^ 
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The Learning Assessment , Program is longitudinal in nature, and the 
various aspects of the curriculum of the public schools are scheduled to 
be assessed ^t regular intervals. In the case of mathematics, the cycle 
is^two years long; in other words, mathematics will be re-assessed during 
the 1978-79 school year. One of the purposes of this assessment of mathe- 
matics in the province was to collect baseline data against which the*per-. 
fo nuance of students in future assessments could' be compared. 

1.1 Purposes of the Assessment ^ 

* . 

The major principle underlying ^the entire Learning Asses^ront Program 
is that decisions about education should be b^sed upon an- un^derstanding of 
what and how children and young adults are le,aming. Education^- decisions 
are being made ev^ry.«y, decisions which affect the allocation of resources 
in-service education Si teachers, teacher training ^programs, curriculum, 
development, and the adequacy of various programs. The Mathematics Assess- 
ment will provide decision-makers at all levels with factual and current 
information concerning the teaching and learning of mathematics upon which 
to base their decisions. 

r * 

The Assessment Program in general and^he Mathematics Assessment in 
particular ar^ designed to inform the public of some of the strengths and 
weaknesses of the public school system in this province. The infiprmation. 
generated by tne Mathemat;Lcs Assessment will assist school distri^s in 
maintaining identified strengths and overcoming weaknesses. Xt is hopVd 
that- Curriculum developers and curriculum revision\committees will bfe able 
tor make use of these result^ in the process of improving curricula and der 
veloping suitable resource materials, furthermore, ^such information coulQ * 
be used in the allocation of resources at both the provincial and district 
levels . . . ^ f 

At the university level, the information generated by the assessment 
will be useful in J-ndicatitfg directions for chan^ge and improvement in tea- 
cher education. Finally, the information produce^! by the assessment should 
be of greatf value .to educational researchers both as^ data bank and as a 
source of researchable questions concerning the teaching and* learning of 
mathematics. 



1'2 Organization of the Assessment * ■ 

Several groups participated in the organization and impiementation of J 
the Mathemati-cs Assessment. These groups included the Learning Assessment 
Branch of the Ministry of Education, the Cqntract Team, the Management Com-r 
mittee, and the B.C. Researdj^ Council. Consultations were held with several 
. other groups as well. ' - " " • 

s « 

The Contract Team was retained by the Learning Assesslnent Branch to 
conduct the Mathematics Assessment. " The Contract Team's' responsibilities 
included conducting the Goals Assessment and developing the set of objec- 
tives to be assessed, constructing the student tests, piloting the tests 
^ind subsequently revising them, constructing the Teacher puestlonnaire , and 
writing the final reports of the assessment. The Contract Team consisted • 
of two members' of the Faculty of Education of the University <)f British 
Columbia, a primary teacher who was on leave of absence from' the New West- 
minster School District, and a teacher of secondary mathematics from the 
North Var^couver School District. 

It was the role of the Management Committee to oversee the operations 
of; the Contract Team and to provide. guidance and suggestions regarding the 
various phases of the assessment. Members of the Management Committee in-' " 
eluded two teachers, a supervisor of instruction, a teacher educator i 
school trustee, the chairman of the Contract -Team, and representati^^es af 
the Learning Assessment Branch. 

The B.C. Research 'Council' under the direction of the Cont;:act Team, , 
conducted the majority of the technical a^d administrative "aspects of the 
•assessment. Their responsibilities included overseeing the printing and 
distribution- of the tes.ts, answer cards, ^nd teacher questionnaires, con- 
ducting the scoring ^nd data analysis, and serving as statistical consul- 
tants" an* advisQxs to the Contract Team and the Management Committee. 

^ ' ' ' \ 

Consultative meetings were held with several groups. Representatives 
of the Contract T^am met with the Mathematics Curriculum Revision Committee 
to discuss aspects of the assessment. In additio|^ Review Panels were or- 
'ganized by the Learning Msessment Branch to discos the objectives to be 
tested in the Mathematic/ Assessment. Such pan'els. wei^e intended to be as 
widel>fe representative as possible of the various groups interested in the 
mathematics achievement of students. (Additional information .conc^eming 
the structure and operation of such panels is given in Chapter 2.5 Finally, 
meetings were held and correspondence exchanged with representatives of 
other assessment programs in No>th America, in order th-at the B.C. Mathe- 
matics Assessment could benefit from their experiences., 

1'3 Components of the Mathematics Assessment 

The Mathematics Assessment consists of four major "components : the Goals 
Assessment, the Student Tests, the Interpretive Analysis, and the Teacher 
Questionnaire. The last component is the subject of a separate volume (Be- 
port\ Number 2) and will not be discussed in any detail here. The first' and 
secfrtid components constitute the substance of this Report and will be more 
thoroughly disdussed in subsequent chapters. The rationale for and the pro- 
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cedures followed In conducting the Interpretive Analysis are treated in 
this section. ^ ^ 



V 



lV3.*l The Goals Assessment * , ' 

It was not within the terms of reference of the Mathematics 
Assessment to attei^t to evaluate students achievement in mathe- 
matics in any particular c5urse or program, or to evaluate the 
entire mathematics curriculum. Neifher was it tlje objective of 
this assessment .to obtain information on the achievement of indi-" 
vidual students orischools, nor on the performance of teachers of 
mathematics. It was the, objective of%the assessment to obtain,' and 
to make widely known, information regarding the .present state of 
student learning in mathematics on a province-wixie basis. In addi- 
tion, each school district is to be provided with a svK^iary of its 
own results. • 

^^he initial and basic decision regarding the Gd'als' Assessment 
was to limit the mathematics content to be assessed to topics which 
most informed observers would agree are among the essential concepts 
and skills of mathematics at the three levels tested: end of primary'^ 
education (Grade/Year 4), end of elementary, educiation (Grade 8), 
and end of public schooling (Grade 12). Three levels of cogni- 
tive' behaviour , called domains in the assessment, each subdivided 
into a number of objectives made up the basic framework of the Goals 
Assessment. 

* The process of i'dentifying the specific concepts and skills t6 
be assessed was based primarily upori*^the recently revised curriculum 
guide for mathematics in British Columbia. In addition to this basic 
document, several other sources were consulted and utilized. Chapter ^ 
2 contains a detailed exposition of this proc^edure, as well as of the 
rather extensive consultation th^t took place throughout the Goals 
Assessment phase of the project. 

1.3.2 Student Tests ' ' • 

Tests were constructed to measure students ' mastery of the ob- 
jectives identified in the Goals Assessment phase.* A sep^rate^ test 
was prepared for each of the three grade levels- involved. For each 
test,' a total administration time of ninety minutes was allotted: 
thirty minutes for i-nst ructions, distribution, and collection of the 
test booklets and answer cards, and sixty minutes' for completion of 
the test. A discussion of the reliability of the students' tests is 
contained in the Technic^ Report. 

Piiot testing Cf the assessment instruments was conducted during 
the late fall of 1976 in several school districts across t;he province. 
(See Appendix A for a li-st of the schools which participated in the^ 
pilot testing.). Approximately 250 stu4ents at each of the three grade 
levels involved wrote the\ests, and their results were used in. deci- 
ding, upon the final form of dhe tests. 
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On the basis of the pilot testing certain ^'tems were deleted, 
others we-re added, and still others were modi fied._ The majority of 
modifications to items represented efforts to improve the readabil- 
ity of the stem of an item or the plausibility of the - distractors . 
All additions and modifications were thet} tried out before being 
included in the final versions of the tests. 

A second purpose of the pil6t tests w4s to ensure that students 
had sufficient time in which to complete" the tests since they werfe 
not ^intended to^be speed tests. Results showed that the majority' of 
•students at each grade level required significantly less than the 
total time allotted, "and that virtually everyone was able to complete 
the test in less than one hour. 

With the exce-ption of a portion of the Grade/.Year 4 test, all. of 
the test items were cast in multiple-choice format with five foils or 
distractors for each item.' In every case,, the foils consisted of four 
possible /answers to the item while the f'ifth foil was "I -don' t .know" . 
The "I 40n't know" bption jjas used in an attempt to minimize guessing 
and in order to provide an outlet for students wha, for one reason" or 
. another, had not been exposed to the material being tested or had 
forgotten it. (For a more complete discussion of the use of "I don't 
know" as a distractor in the Mathematics Assessment tests, see Robi- 
taille, 1977.) , ' ~ • 

^ In an effort to assess change in students' abilities to deal with 
certain conceptS/and skills,, some items appeared on two or more of the 
tests. For example, the same five items dealing with knowledge and 
understanding of the units of thfe metric system of measurement were ■ " 
used on all three tests. In sever^ of the skill areas, the same item 
or items appeared on the Grade/Year 4 and 8 tests, or on' the Grade/Year 
8 and 12 tests. Overall, there were nine itemp common to the Grade/ •. 
Year 4 and 8 tests and forty-three items colfiraon to tlie Grade/Year 8 and-^ 
12 tests. This includes five items which were common to all three 
' tests'. 

The International System of Units (SI), was utilized for all test 
items involving measurement; no items contained British or Imperial' 
units of measurement. Furthermore, any numeral containing five or . " 
more digiftwas written with a space between periods ratherr than a 
comma (43 256 not, 43,256) and any decimal fraction with absolute value 
less tl^an one was written with a zero before the decimal point (0.86 ' 
not .86), except in the case of computation items. 

The decision to use the metric system of measurement exclusively 
did restrict, to some degree, the number and the nature of problem- 
solving items involving measurement concepts. For e;tample, it was 
felt that including items dealing with the purchase of consumer goods i 
such as carpeting, or .concrete, or the like, irj terms of metric units 
of area or volume would-make such items appear overly unrealisgLc' and 
unfamiliar since these terms and units ^re not yet in wi'despread use by 
consumers in our society. On the other hand, since the curriculum 
guide does call for implementation of the metric system of measurement 
in the schools, any reference to the Britishi systep was avoided. 
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1.3*3 Interpretive Analysis ' >• 

As part of the Language B,C, project whfth took place during 
1976-77, the Lemming Assessment Branch assembled a panel of eleven 
educators and assigned tHem the tabk of interpreting the assessment 
results,' Such an approach to the interpretation of assessment re- 
sults is not without its problems: the procedure is necessarily sub- 
jective it) nature,* the panel members may not be truly representative 
of the various groups having an interest in the results, and further- 
more, such an analysis might; give a false impression of precision or* 
exactitude by assigning numerical values to decisions based on such 
subjective information, ^1 

On the other hand, no assessment program would be complete 
without some type of interpretation of the raw data. Since no ob-. 
jective standards existed at the time of the assessment, some form 
of Interpretation Panel . analysis ►was the only choice available, A 
discussion of some of the difficulties inherent in interpreting assess- 
ment results may be found in Weiss and Conaway (1976), 

Three fifteen-member Interpretation Panels, one^or each of the 
^three grade levels involved, were coijstituted by the Learning Assess- \ 
ment Branch, Each panel consisted or seven teachers of mathematics 
at the particular grade level, two supervisors of instruction^ tw^^ 
teacher educators, two 'school trustees, and two members of the public 
at large. Every panel member rebeived a copy of one of the three 
assessment :(.nstruments alon^^ith information and ins true j^ions. 

Prior to -meeting as^a group, the members of each Interpretive 
Panel were asked to perform several tasks, keeping in mind the age 
and level of the total population of students to which the test was 
administered: - ^ ^^^-^ 

(1) Answer each question on the test and check their responses using 
the answer key provided, ^ 

(2) review the booklet in which the test items 'were organized into^ • 
objectives and dqjnains, 

(3) esta^biish, in percentage terms, two Jevels of performance /for 
each item — "acceptable" and "desired", remembering the range 

of individual differences among students as well as 'the variation 
in programs throughout the province, and 

(4) record the two levels for each item on the form provided for that . 
- purpose. 

At this stage, the panel members were npt given access to the actual 
results obtained by the students. 



The panels met in Vancouvet in early June, Each panel was 
chaired jointly by a member of the Cqntract Team and a member of the 
' Management Committee, The panelists were first given the provincial 
\ results for th6ir respective tests and asked to compare the actual 
\ result obtained for each item witli the range^acceptable to desired) 
which they had established earlier for thaf^em. Using that range 
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as a general focus for* consideration rather than as a specific, arbir 
trary range allowing no latitude, they were then asked* to rate each • 
item on a five-point scale of satisfaction: 

5 Strength 
4\« Very satisfactory 
3^ Satisfactory ^ 
' 2 =^ Marginally satisfactory 
• . 1 = Weakness. — poor performance 

The criteria of ' satisfaction were unique to eafch panelist and depended 
upon what each one 'felt' student performance' on a given typ.e' of item 
should be. In arriving at their decisions, th'ey were aske'd to beaj: in 
mind the following factors: ■ ^ 

(1) the total population' pf students at this level in British -Columbia 

(2) tl^e wide range of individual differencis present witliin the ^ade 

• level, « 

< • • * • 

(3) the considerable var4.ation in instructional goals and/or methods 
throughout the schools of the province, and 

(4) the difficulty of the i tems . 

Upon completion, of this individual' task, the panelists formed seven « 
sub-groups of two or three members in order ta compare their ratings. 
,and to arrive at a consensus rating. They, were also asjled to record 
any ct)nflnents they, might care" to make. The result i«i ^even sets of\ 
pair ratings were then averaged afnd discussed^ with a view to obtaining 
group agreement on each item. An opportunity was provided for strong 
minarity opinionjs to- be recorded'. 

Finally, each panel was divided into three group of five as 
follows: * 

Group A , Group B . Group C 

1 Teacher Educator 1 Teacher |^jicator 1 Public i 

1 ^Supervisor 1 Supervism^^l - * 1 Trustee 



2 Teachers • 2 Teachers^lg^ . 3 Teachers 

1 Public » 1 Trustee " - . , ^ 

Each group was assigned- one domain (i.ei, a set of related objectives) 
and was asked to provide anecdotal* comments for each objective in its 
assigned domain. The comments were to identify strengths and weak- 
nesses of student performance based upon the items used measure the 
objective. In soioe case^, '"comments upon performattce by sTOdents Oii " 
individual Items were given. ^ 

V 1 

, When all three'^roups were finished, the panel re^asserabled to 
discuss the anecdotal, comments. Modifications were made whete they 
were deemed appropriate, an d^ any strong minority views wete^'reqorded. 
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The information gained from the deliberations of the Interpre- ' 

* tive Panels was used by the authors of this report in commenting .upon 
the results of the assessment. Although the procedure used does lack 
some air of precision attributed to strictly numerical comparisons, 

,the wealth of experi^ce which the members of the' panels brought to 

• bear upon their examination and interpretation of the results gives 
their interpretations considerable credibility. 

1.3.4 Teacher Questionnaire 

Two questionnaires, one for fifeachers Jf elementary school mathe- 
matics and the other for teachers secondaify school mathematics, were 
developed for use in the Mathematics Assess/ent. The questionnaires, 
which were answered anonymously, dealt with^ various aspects of the tea- 
chers' backgrounds and training as well as/with facets of the method- 
olo^ of teaching mathematics at different levell, and with instruc- 
tional materials used by teachers of mathematics. 

Teachers of mathematics at each of Grades 1, 3, 5, 7, 8, 10, 
and 12 were systematically selected as potential respondents to one 
of the questionnaires. Those selected were mailed a questionnaire 
sholrtly after the administration of the student tests. Of the 3451 
questionnaires sent out, 2955 were returned completed for a return 
rate of 85.6%. The data obtained from the questionnaires are analyzed 
and discussed in Report Number 2. 

Student Characteristics as Reporting Categories 

A number of^ factors are either known to be or are strongly suspected 
of being related to students' performance in mathematics. While it would 
not be possible to identify a casual relationship between a given student 
characteristic and performance on the assessment test as a part of the 
Mathematics Assessment, it is 'possible to identify variables that appear 
to be related on the basisof-the data collected. Relationships so iden- 
tified may lead to folLow-^up studies specifically designed to identify 
cause and effect relationships on the basis of the correlational results 
discovered in the assessment program. 

\ As a part of each of the three Mathematics Assessment tests, students 
W&re asked to report on several aspects of their personal backgrounds. A 
list of the reporting categories yhich were used as well as the grade 
levels at which they were used is given b^low. Each is accompanied by a 
brief statement which attempts to explain why each such reporting category 
was used. ^ 

* * ♦ 

1-4.1 Mathematics Background (12) 

\ Students with extensive backgrounds in mathematics will undoubt- 
. edly outperform students who, for example, hdve studied no mathematics 
.since pompleting their last compulsory course in Grade 10. Many indi- 
viduals and groups 'expressed an interest in seeing how this latter 
group of students would do on the test. 
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\.k.l Date of Birth (4, 8> 12> 

There is some evidence (Callahan and Glennon, 1975) ,that, in 
the lower grades at least, chronological age has» an effect on mathe- 
matics achievement • Although the results are not consistent, older ^ 
children appear to achieve better in mathematics than do their yo^iinger 
classmates and 'this effect seems toxoid more for boys than it does- ; 
for girls • 

1-4.3 Sex (4^ 8, 12) « . ^ 

There is currently a considerable amount of interest in the 
area of sex differences in achievement in mathematics. Several major 
studies, notably the National Longitudinal Study of Mathematical Abil- 
ity and the^National Assessment of Educational Progress (NAEP News- 
letter^, 1975) both in the U.S.A., have stated that boys, after the 
age of 13, consistently outperform girls at the higher levels of cog- 
nitive functionjjig in mathematics. More recently, Fennema (1977)'"'^s 
seriously questioned these conclusions and has obtained evidence which 
fails to show any sex differences in achievement. 

1.4.4 Number of Schools Attended (4, 8, 12) * ^ 

Many educators believe that there is an inverse relationship 
between the number of schools attended by a student and that students' 
achievement. Results from Language B.C. (Evanechko and S^ith, 1976)' 
showed a consistent decrease in 'performance in reading with an increase 
in the number of schools attended. As Evanechko and Smith warn, how- 
ever, such results must be interpreted with caution. **It may not be 
tVie mere fact of moving to another school that results in lessened 
performance as much as it could be various emotional and social fac- 
tors associated with the mov^ or perhaps the instability of the family 
or even the family's socio-ecohomic status." (p. 27) 



1.4.5 Residence in Canada and Language Spoken (4, 8, 12) 

Length of residence in Canada and language spoken were found 
to be quite highly related, to reading performance in Language B.C. 
(Evanechko and Smith, 1976). As the percentage of non-native speakers 
of English in the schools of the province continues to grow, informa- 
tion concerning the relationship between that variable and achievement 
in all areas of the curriculum, including mathemat'dfcs, will be increa- 
singly important. 

1.4.6 Number of Hours of Television Watched (4) 

n 

The cover story in a recent issue of Newsweek magazine discussed 
the predominatly negative efJects on children of television watching. 
Among the many results in this area, the relationship reported by. 
Language B.C. is interesting. "There is generally an increase in per- 
formance in reading with an increase in television watching up to two 
hours per day, then a slow decrease to the four or more hours per day 
category" (fivanechko and Smith, 1976, p. 32). 
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If any relationship between television viewing and mathematics 
achievement does exist, it may prove to be related in an important^ 
way to one or more variables more closely linked to school performance", 
e.g., time spent on out-of-class assignments. 

1.4.7 Use of Hand-Held Calculators 8^' 12) 

Hand-held calculators are fast becoming ubiquitous and will 
•undoubtedly have an impact in the field of Mathematics Education. 
Although it may be too ^arly to *16ok for or to expect to find evidence 
of a relationship between use of sucbP devices and mathematics achieve- 
ment, educators should be aware of the extent to which students make 
use of calculators both^^Jj}. a%d out of school. In addition the data 
obtained now shoiAd be usefuF for comparison purposes in future ass- 
essments . 

1.4.8 Time Spent on Homework (8, 12) 

• The evidence regarding the effect of homework assignments on 
students' achievement is, as is so often the. case in education, equi- 
vocal (Callahan and Glennon, 1975). Perhaps because of tTiis, teachers 
at all levels seem to be assigning less and. less homework. With the 
information gained from this item, it is possible ^o compare perfor-' 
mance on the assessment test with the amount of time .students reported 
spending on homework. 

1.4.9 Parents' Educational Background (12) 

The National Assessment of Educational Progress reported that 
students' achievement in computation varied directly with the highest 
level of education attained by their parents (NAE^P, 1975a). The data 
obtained here provide an opportunity to relicate the NAEP finding in 
,a different social context. 

1.4.10 Future Plans (12) 

Students future plan^ n^pbably are highly correlated with 
their mathematics backgrounds .^f hat is, the more academically orien- ' 
ted students will likely take more mathematics, perform better -on the 
tests, and proportionally more of them will plan to continue their 
studies at* th^ post-secondary level 

1.4.11 Out-of-School Work (12) 

Many secondary students Jiold part-time^jobs which occupy a 
considerable portion of their out-of-school ti&e. The purpose of 
this item was to collect information which could indicate the 'direc- 
tion, if any, in which such involvement affects mathematics achieve- 
ment . 

Assessment tests in heading' were also given at the Grade 8 
and 12 levels, and these tests contained similar, and in some cases 
identical, background and information questions. For example, on 
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both the Reading and the Mathematics tests, students wer^ asjced their, 
date of birth, sex, and. number of school^ attended/ Because of the 
common items, it was possible to merge the two sets of data and obtain 
a new data file containing the information and results obtained on 
both* of the tests. Matches were obtained for 66% of the Grade 8 stu- 
dents and 63% of the G^ade 12 students. This new file was used to, 
obtain further information on student background, as well as to cor- 
relate some aspects of student pe^rformance in reading with the same 
students' achievement on some mathematics objectives. For example, 
it was^ then possible to obtain a measure of the correlation that exists 
between reading comprehension and the ability to solve mathematics 
problems. \ 

The results obtained from the recording category ^ata are dis- 
cussed in Cl^apters 3 through 6. Not every comparison that was made 
has been reported. Because of limitation^ of time and space available, 
only those deemed to be most important ox interesting haj/e been men- 
tioned. , 
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In the chapter, "A View of' Education," Bloom et al (1971) list five 
areas they intend to encompass in their discussion of evaluation in ^ 
education. All five areas 'are concerned with using evaluation to improve 
teaching and learning. Of . the five areas, the one that generates the most 
immediate impact is, "Evaluation as' an aid in clarifying^ the significant >i 
goals and. objectives of education and as a process for determining the 
extent to which students are developing in these . desired ways." (p. 7-8). 
In general terms, the Mathematics* Assessment measured the extent to which 
students were developing with respect to the essential skills of mathe-, 
matic§ in British Columbia. 

In more specific terms, the Mathematics Assessment measured ^the extent 
to which students at the end of their primary, elementary, or public school- 
ing have mastered what might be termed the minimum essentials of mathe- 
matics. Many sources were used in deciding what to include as minimum 
essentials: i.e. whaL^every student at. the specified grade level should 
have learned. Some Jl^the more useful of these sources are deacxibed below. 
References to specific publications which were of importance to the Mathe- 
matics Assessment are listed at the end of the chapter. 

1. Publications of the National Assessment of Educational Progress: 
The Education Commission of the States created the Committee on 
Assessing the Progress in Education, which has since been re- 
named NAEP, to initiate a project through which ten areas of the 
curriculum, including njathematics , would be 'assessed on a nation- 
wide basis on a three-year cycle. Mathematics was first ass- 
essed 1972-73 and re-assessed in 1977. NAEP publishes individ- 

I ual pat>ers, reports, and a newsletter. 

2. Publications- of the S^h^ol Mathematics Study Group (SMSG): SMSG 
was undoubtedly the/^st influential of the groups that produced 
experiment ai. matheclaqics curriculum materials during the 1960* s 
and earl'y 1970*s. Inaddition, SMSG directed the ilational ^ on- 

v^itudinal Study of Mathematicalb ilities (NLSMA) . " NLSMA was a 
%^ ^ ^longitudinal study designed, to assess the mathematical abilities 
of students in grades 4-12 during the period 19&2-67. From 
1958 through 1973 SMSG published many newsletters and reports. 

3. Publications of the Natiooa{^ouncil of Teache'rs of Mathematics 
(NCTM): The NCTM published a series of 'articles dealing with ^ 
NABl' results from the Mathematics Assessment in THe Avithmftio 
Teaoher and The Mathematics Teacher between 1975 to 1977. Other 
articles on ^assessing, mathematical skills have* appeared period- 
icafiy in NCTM publications. The NCTM has also used its journals 
to publish articles on basic skills. A statement 'of NCTM's of- 
ff<;;ial position on basic skills appeared in the "March 1977 issue 
of the NCTM Bulletin for Leaders, mrch 1977. 
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4. State Assessment Programs: Many states in the U^S.A. have impl6- 
m^nted their /Own statewide mathematics assessments programs* 
The material/B produced by several of the state assessment pro- 
afams were yuseful in the planning of the Mathematics Assessment 
lor Britisftv Columbia* v 

5". Maihematies kurrioulm Guide Years One to Ttoelv^: *Tlre official 
Mathematics Curriculum Guide J^sued by the Ministry of Education 
of B.C. was' the one publication most frequently used in the 
planning of the B.C. Mathematics Assessment. The Guide contains 
the most accurate reflection of the current content presented 
in the mathematics classes in th^ schools of B.C., and includes 
the grade placement of the different mathematics top^ics. 



The procedures used in going from a general set of statements about 
^,;3^^ssment to the specific objectives to "be measured in the B.C. Ass€y5s~ 
menc of Student Learnings in Mathematics are described in the remainder 
'-oi this chapter. ^ 



2.1 Development of the Item Specif ication^Model 



in 



On the bisis of suggestions and Ideas gleaned from the sources'' 
described abojfe as well as ftom consultations with educators locally, 
work was begun on the development of an Item Specification Model (see 
Figure 2-1) for the Mathematics Assessment. As has been suggested else- 
where (Bloom, et alj 1971) , the development of such a model is a necessary 
first step in the planning of any majo'r evaluation ^program such as this , 
assessment. * 




Figure 2-1: Item Specification Model for the B.C. Mathematics Assessment 
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All major assessment projects in mathenytics> including NLSMA, 
NAEP, and the International Study of Educatipnal Achievement (lEA) 
have developed models upon which to base their Evaluations. The 
purposes served by the models may have vaified^ but thdir use is uni- 
versal. One of the main purposes segpved by th^e Item/ Specification 
Model was that it focused attention upon the fact that mathematics 
'achievement is multi-faceted. Since mathematics . achievement is not 
a unitary trait, tfie assessment strategy applied must include different 
measfures of various aspects of mathematics. 

llathematics achievement is multi-faceted; the Item Specification 
Model is^ multi-dimensional. The first dimension on the model is ^ » 
grade level. As described earlier, the ^three points on the K-12 con- , 
tinuum selected for testing were end of primary education, elementary 
education, and public schooling. Since one cannot reasonably expect 
that all of the Grade 3 mat);iematics curriculum has been covered before 
the end of year 3, the assessment instrument was adMnistered in year 
4. Similarly Grade 8 was chosen for a^ministratio.^;i^f the end of 
elementary education assessment. In order to assess student perfor- 
mance in mathematics at the end of their public schooling, the ass- 
essment instrument was administered to all students in Grade 12. 
However, since mathematics not required *aft^r Grade 10, the mathe- 
matics content on the assessment instrument administered in Grade 12 
was restricted to the Grade 10 level or below. 

K 

The second dimension of the Item Specification Model is content, 
that mathematics which was to be tested. Of all the' major mathematics 
content areas that could have been used, the following four were 
selected: Number and Operation, Measurement, Geometry, and Alg;ebraic 
Concepts. Topics classified as belonging to the ^umber ^nd Operation 
category dealt with the nature and properties of whole numbers, integers, 
rational numbers, and real numbers as well as with techniques ^nd prop- 
erties of arithmetic operations.. The Measurement category included 
topics such as selecting the most appropriate unit of measurement^ famil- 
iarity with metric units of measurement, area and perimeter, angular 
measurement, and scale drawing. Topics in the Geometry pategory dealt 
with the identification of geometric figures, classification of angle3 
and trianjgles, parts of the circle, and the Theorem of Pythagoras. 
Topics in the Algebraic Concepts category were conceijied with graphs, 
writing algebraic expressions, simplifying and evaluating polynomials, 
linear and quadxatic equations, slope of a line, and ^simultaneous equa- 
tions. ^ s c y . ' 

Xhe final dimension of the Item Specification Mod^l consists of 
three i^els behavior, which are referred to as domaii^s. Definitions 
Snd Ttppilr^ations , were adapted from Wilson's definitions of cognitive 
^behaviours (Wilson, 1971% p\ 648-649). The Computation and Knowledge 
domain encompasses areas such as knowledge of specific facts, knowledge 
of terminology, ^d ability to use algorithms/ The'^Compreh^nsion domain 
includes knowledge of concepts, knowledge of principles, rules, generaj,- 
izations, ability to transform problem elements from one mode to ^another, 
and ability to read and interpret a problem. Ability to s^lve routine 
problems, ■ ability to analyze data, and ability to recognize patteims 
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^belong to the Applications domain. 



The domain dimension of the Item Specif icatien Model is hier- 
archical, ^he Applications domain is more cognitively complex than 
.Comprehension, \Jfiich is in turn more complex than Computation aad 
Knowledge, Fc^'lowing are three items tdken from the Grade 4 ass- 
essment test. Each, item measures an ^pect of Numbet^and Operation 
area of the Model, but each is from .a different c^ 11 'in, the Domain 
dimension of the Item Specification Model: 



(26) Add: 



185 
+ 432 



' (45) 



The 2 in 2645 meaiis: 



2 hundreds /_/ 

2 thousand's •'^ , , , i , • J / 

2 ones ...^ [j 

2 millions , , / / 

I don' t know • / / 



(53)/ 



On Monday, 185 peoj;vle saw the morning wtiale shows' and 
412 people saw tht afternoon whale ^hows, ffow many ' 
people saw the whale shows that day? 



597 , 

697 

327' 

373 : 

I don't know. 



11! 

n 



r 



Item 26 belongs to the Computation and Knowledge domain,' Item 45 - 
^ the Comprehension domain, and Item 53 to the Applications domafn of 
Number and Operation content area. It should be noted- that in order to^ 
so^-ve Item 5>, i^5 and 412 must be added?' This is the same computation 
a&^required in Itfem 26. ' ^ • 

The Item Specification Model for the Mathematics Assessment is a 
3x4x3 "cube*/i three grades (4, 8 and J2) , four major mathematics 
content areas (jqumber and Operation, Measurement Geometry , and Algebraic 
Concepts), and^ three domain^ (Comput^ation and Knowledge, Comprehension, 
and Applications). The essential idea of the model is that the objectives 
and te^ items for the Mathematics Assessment: can, be classified ^n \ 
ways: by grade, by Content area, and by domain.^ 

The mddel, as simple as it is, emphasizes the complexity" of outcomes 
of mathematics learning. Many important areas of mathematics are not 
included,/ and no mention is made of attitudes toward mathematics. In 
this assessment, concern was limited striatly to cognitive outcomes** 
It is a]/so true that although the model contains thirty-six cells, some 
of theWare empty. For. example, no attempt was made at the Grade/Year 4 
level to test the area of Geometry, and the Algebraic Concepts domain 
at that level* included only two graphing items. 
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2^2 Process of Development of Domain and 'Objectives ' ' 

, Much attention has been given recently to the importance of stating 
objectives for education* Books on teaching methods, stretes educational 
objectives, teacher-training courses typically have a requirement that 
lesson plans prepared by student teachers include a statenn^nt of objec- 
tives, and the mathematics textbooks used in the schoc3<4s of B.C. all 
include sta^tements of objectives for lessons or units in their teachers' 
edij^ons. In similar fashion, a set of specif ip objectives- correspond- ^ 
ing to the domains discussed in the previous section was' developed for 
use in the Mathematics Assessment. TKis set of objectives went 
through a very lengthy^ process of, review and revision. Each objective 
generated was studied by the Contract Team, and the Management Committee. 
The penultimate version of the set of objectives was then ' submitted to 
four Review Panels for review and revision. ^ 

2. 2^1 Review Panels 

Four Re:view Panels were organized to afford people who were not 
involved in the creation of the objectives an opportunity of examin- 
ing and proposing amendments to the objectives before the student 
tests were develo-ped. The panels met with representatives o5 tfie 
assessment program to discuss the objectives and to sjpek to improve 
them. ^ 

The members of each Review Pamel were chosen by the Learning 
Assessment Branch frtm a list of teachers mo^t of whom had been 
identified by their district superintendents as being highly 
qualified in the field of mathematics, school trustees nominated 
^ by the Ministry of Education, and lay people who were identified in 
several ways, but mainly by school district superintendents list- 
ing people active in their communities. The basic make-up of each 
of the four mathematics Review Panels Is presented in Table 2-1. * 





Table 


2-1 






Review Panel Members 




Richmond 


Haney 


Castlegar 


Victoria 


11 Teachers 


11 Teachers 


13 Teadbers 


11 Te^achers 


1 Trustee 


3 Supervisors 


3 Lay persons 


2 Principals 


"^T^tipervisor 


1 Principal 


3 Supervisors 


3 Lay persons 


1 Lay person 


4 Lay persons 




2 Trustees ^ 


1 Administrator 
^ 


, 2 Trustees 




1 Teacher Educator 



Each member of the Review ^Panels was sent a 'copy of the object- 
ives for the Mathematic;^ Assessment. Accompanying each objective 
was an example item .feffat could be used to measure the objective. 
Before coming to the all-day meeting, each panel member was asked to 



examine and consider these objective^.j to make suggestions regard- 
ing the possible i^^es and methods of dissemination of the in;foi;- 
matioh gathered, to suggest other types of information they would 
like to see g^hered, 'and to propose ways in which such information 
could be collected by the Mathematics Assessment Program. 

The meeting of each Review Panel began .with the entire group 
discussing thi I^tem Specification Madel and commenting on each • . 
dimension and e^ch category of each dimension* The Review Panel ^. 
and assessment representatives then divided into three sifbgroups, 
on^ for each of three grade levels involved in the assessment. 
Each subgroup discussed the objectives for its grade level. When 
the discussion was cotapleted the entire. group reconvened and each 
subgroup reported the results of its discussion to the entire group. 
The Review rfanel then made it3 fina^ critique and the results were 
reported to the assessment group. 

Two meetings were also 'held with the B.C. Mathematics Curriculum 
Revision Committee. The meetings were organized in a manner similar to 
the Review Panels except that the Revision Committee ciid not subdivide 
to examine each^rade level. The committee as a whole considered the 
entire set of objectives. 

Additional feedback concerning the objectives was qbtained by having^ 
the objectives published in Vector (Kelleher, ^t-fia^- i97^K , the journal 
of the B.C. Association of Mathematics Teachers;- and by discussing the 
objectives at the Summer Mathematics Conference of the B.C.A.M.T., at the 
Northwest Mathematics Conference, an'd at several professional day meetings 
of school districts. * ' " 

The final version o'f the objectives, organized by grade' level and 
domain, are presented in Tables 2-2 through 2-4. The right hand column 
in each of the three tables gives the number o£ items oft the assessment ' ^ 
instrument used to measure mastery of the accompanying objective. 
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labile 2-2 






Domains 


and (Objectives/fpr Grade/Year 4 






DOMAIN 


• 




NUMBER 
OF ITEMS 


1. 


Computation and 
Knowledge 


1.1 

• •* 
1.2 


Mastery of Number, Facts 
Addition of Wbple Numbers 


24 
5 






1.3 


Subtraction of Whole Numbers 


5 ^ ' 






1 A 


raiowj.eQge 01 [Mox^uion ana 
Te nntnofo''gy ^'\} ^ 


6 


9 


LfOuipL cii cub xon ^ 


2.1 


Understanding of Place* Value 
Concepts - ^ 








2.2 


Understanding of Number Properties 


J 4 






2.3 


Understan4ing of Measurement 
Concepts^ 


s 






2.4 


Understanding of Fraction* Concepts 


2 


3. 


V 

Applications 


3.1 


Solve Computational Problems 


6 




> 


3.2 


Solve Practical Problems 


6 
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The Grade/Year 4 Mathematics Assessment instrument contained sixty- 
nine items measuring mastery of ten objectives. The data in Table 2-^2 
show that the major emphasis in this assessment was in the Computation . 
andrKnowledge domain. Of the forty items in this domain, twenty-four 
were* used to assess the Mastery of Number Facts objective. These items ^ 
tpok the form of six number facts for each of addition, subtrkction, 
multiplication, and division. In addition to the number fact items, there 
were ten addition and subtraction exercises requiring use of tjie a'lgorithms. 

Ii\\he Comprehension domain the emphasis was still on numbers, in 
particularmfiderstanding place value concepts', and number properties. There 
were five items on measurement and two on fraction concepts. The Applic- ^ 
ations^ciomain was evenly divided between Qdfcputational problems and 
problems termed practical: i.e. working with time, mo^ney, graphs. 

Several cells fn the Item Specification Model were not tested at * 
the Grade/Year 4 level. Suck exclusions occurred for two main reasons: 
eithet the content was not part of fche Grades 1-3 curriculum or th"e 
mater^dl .could not be adequately assessed by means of a paper and pencil 
test. For example, in the primary grades very little is done with the 
algorithms for multiplication and division. Certain sets of numbers, for 
example, decimals, are not Vpresente,d in the primary grades. 

^ • > / 

Geometry, on the other hand, is discussed in Grades 1-3, but is 
not listed among the objectives for the Grade 4 Mathematics A3sessment. 
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The geometry instruction in the primary grades is based upon the manip- 
«la!j:ion of concrete objects. The two geometry^ objectives- 'for Grade 3 
listed in the^ Curriculum Gaii^ are. as follows: | ' • ' 

1 The student ^.g^n^t rue ts simple geometric models 
^ of solids and plane, shapes, • ^ ' 

the student recognizes axis of symmetry from experiences 
, with* concrete materials • ^ ' ^ - 

Given that the assessment instrument was a paper and pencil test, the 
geometry objectives could not be included. on the Grade 4 mathematics ' 
assessment • * ' ■ < 

^^^i^ 1'"^ contains the domains, objectives, and the 'number of items 
per obj^ti^e f9r the Grade 8 Mathematics Assessment instrument. The 
test contained sixty, items measuring acquisition of twelve objectives.* 

- , - ' 

Table 2-3 



Domains and Objectives for Grade 8 



^ DOMAIN 



OBJECTIVE 



^VNUMBER 
OF ITEMS 



Computation and 
Knowledge 



2. Comprehension 



3. Applications 



;,1.1 Computation jd^thJiZhel^ Numbers 

1.2 Computation with. Rational Numbers j 
' in Fraction Form,^?^ \' r 

1.3 Computation v^th Rational Nu^ers 

in Decimal Form 

1.4 Knowledge of Notation and 

Terminology . . ♦ 

1.5, Knowledge' of Geometri'c Kacts 

Equivalent Forms of^tional 
^ H Numbers ^ / 

2.r CompTfehension of Number Concepts 

2.2 Comprehegision of Measurement 

Concepts 

2.3 Comprehensibn of Geometric Concepts 
2;^ C6mprehension of Algebraic Concepts 

3.1 Solve Ptoblema involviiig Operations 

wit^ Whole Numbers, Frefctions, 
Decimals, and Percent V 

3.2 Solve Problems involving Geometry 

and MfeasuremeifT 



^5^ 
4 



6 
5 

4 
3 
7 




The emphasis in the Computation and Knowledge domain for Grade 8 is 
on computation, with different sets of numbers. Assessment of knowledge 
of geometric facts in included in the Grade 8 assessment. Geometry, in 
fact, is a factor in each domain for the Grade 8 assessment. All four 
content areas are assessed in the Comprehension domain, but with varying 
numbers of items. The emphasis in the Applications domain is on solving 
problems using different sets of numbers and nunfiers in different forms. 
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A comparison of Tables 2-2 and 2-3^hows that thejaaji 
fefetwe^IX ^he Grade 4 and 8 levels are_ £oua4-^^-n--tire^Tnc^ of geometric 
concepts anrTnn:Tre^sriitt in emphasis in the Computation and Knowledge 
Momain in the Grade 8 test. By Grade 8, computation includes all four 
basic operations with whole numbers, rational numbers in fraction form, 
and rational numbers in decimal form. | 

Table 2-4 lists the domains, objectives, and the number tif items per 
objective for the Grade 12 Matheihatics Assessment. The test contained 
seventy- two items measuring acquisition of eleven objectives, 



Table 2-4 
Domains and Objectives for Grade 12 



DOMAIN 



OBJECTIVE 



numbe; 

OF IT^MS 



1. Computation and 
Knowledge 



2. Comprehetision 



3 . Applications 



1.1 Computation with Rational Numbers 4 

in Fraction Form 

1.2 Computation with Rational Numbers 5 

in Decimal Form 

1.3 Knowledge of Notation and 14 

Terminology \ 

1.4 Knowledge of Other Algorithms ^ 7 

2.1 Comprehension of Number J[Ioncepts* 6 

2.2 Comprehension of Measurement 5 

Concepts 

2.3 Comprehension of Geometric 4 

* Concepts ^ 

l^k Comprehension of Algebraic 9 
Concepts ^ 

3.1 Solve Problems Involving 9 

Operations with Whole Numbejs., ^ 
Fracffions,^ Decimaler,' and Percen 

3.2 Solve Problems Involving 

Geometry and Measurement 

3.3 Solve Algebraic Problems 



27 



In the Computation and Knowledge domain, the Knowledge of Notation 
and Terminology objective involves several more items than were required, 
for Grade 8, Computation wi-th Rational 'Numbers is still included, but 
Knowledge of Other AlgoriAms has been^ added. The Comprehension domain 
for Grade 12 looks very similar to that for Grade/ 8 except for Comprehen- 
sion of Algebraic Concepts whicR assumes a more important position .in Grade 
12 than it had in Grade 8. theXpplications domain is most comprehensive - 
for Grade 12, involving eighteen iteo^^^/Algebraic problems are presented ^ 
for the first time and the other two categories have more items than in 
Grade 8, particularly geometry and measurement proble.ms* 

The Grade 8 and 12 objectives havdriA| similarities* In fact, many 
* of the items on the Grade 8 mathematics^B^ssment were repeated for the 
Grade 12 assessment. The common items were used for comparison purposes. 

The set of Grade 12 objectives, unlike Grade 8, includes no reference 
to computation with whole numbers; it is replaced by knowledge of other 
algorithms • The Grade 12 set of objectives .reflects a much stronger 
emphasis on the Algebraic Concep,ts content area and the Applications do- 
main. 

The distribution of items organized by grade and content area. is 
presented in Table 2-5 below. Since the tests were of differing lengths 
(Grade 4 - 69 items. Grade 8-60 items. Grade 12 - 72 items), the data 
presented in Table 2-5 are percentages. The -fact that some of the rows 
in the table do not have a total of 100% is due to the effect of round- 
ing each percentage to the nearest whole number.' 



Table 2-5 



Percent of Items in Each Content Area by Grade 



Content Area . . 


Grade 


Number and 
Operation 


Measurement 


Geometry 


Algebraic 
Concepts 


4 


78 ■ 


17 


0 


3 


63 


17 


' 12 


8 


12 


50 

• 


15 


15 


19 



The data in Table 2-5 show a decreasing emphasis on the Number and' 
Operations content areA as grade level increases, and an increasing 
emphasis on the Algebraic Contepts contend area. The Measurement content 
area has^ a very consistent emphasis as does Geometry in Grades 8 and 12, 

The distribution of items organized by domain and grade level is 
presented in Table 2-6. A^ with Table 2-5, the data in Table 2-6. are 
percentages. 
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Table 2-6 

Percent of Items in Each Domain by Grade 
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Grade 



4 

,8 
12 



Domain 



Computation 
and Knowledge 



Comprehension Applications*. 



58 
53 
42 



25 
30 
33 



17 
17 
25 



The data in Table 2-6 show several patterns • The percent of items 
decreases as the level of complexity of cognitive behavior increases. 
Within a domain the emphasis remains rather stable for the three grade 
levels with a slight decrease in the Computation and Knowledge domain as 
grade level increases and slight increases in Comprehensi^gjuand Applic- 
ations domains. 

The data presented in Tables 2-5 and 2-6 reflect the g^oals ob the 
'B.C. Mathematics Assessment pr6gram. The major goal was to assess student's 
performance on some of the essentia^ skills of mathematics which are pre- 
dominantly number and operation oriented. Although the assessment examined 
students' knowledge and computational abilities, it did not ignore the 
cognitively more complex domainsV. , ' 
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Chapter 3 

GRfDE/YEAR 4: RESULTS, INTERPRETATION, MD RECOMMENDATIONS 




This chapter contains a discussion .of the Grade/Year 4 results for 
each item and for each objective assessed.* A limited number of ems 
from tjie assessment instrument ^are presented and discussed as illustra- 
tive examples; howe^jer, because of space limitations, it was not possible 
tQ disqu;5s each^dLndividual item in ,debail in this chapter. A companion 
volume in the series. Report Number 3: Technical Report contains summary 
information dbout each item on each of the three tests. Copies of the 
Technical Report* may be obt-ained from the Learning Assessment Branch, 
Ministry of Education. 

3. 1 Description of the Test 

"'The Gi:;ade/Year 4 test contained sixty-nine items designed to assess 
students* mastery of, ten objectives of the primary grade mathematics 
curriculum which were grouped into the three domains. In addition to 
these mathematics items, the test contained thirteen background inform- 
ation items which students were asked to complete before taking the test. 

Items 1 - 39 on the Grade/Year 4 test were open-ended. Items 40 - 69 
were multiple-choice exercises. Students responded to the test items in 
the test booklet itself by either writing the answer for open-ended exer- 
cises or marking their choice of answer with an "x" fbr the multiple- 
choice items. The information from the booklets was then keypunched into 
machine- readable format. 

One and one-half hours were alloted for the test: thirty minutes 
for instructions, distribution and collection of the test booklets and 
completion of the background informatiop' items, and sixty minuses for 
completion of the test itself. The background informat'it)n items were 
administered first. Teachers administering the test were asked^ to read 
each of these items to their students and to assist them in completing 
the items correctly. 

.The test itself was divided into thr4a parts. Part 1 was timed and 
consisted of twenty- £our basic fact items, six for each of the operations 
of addition, subtraction, muitiplication , and division. Students were 
given four minutes to complete this portion of the test. Paints 2 and 3 
were not speed, tests; students were given osfie hour to do the items on 
this portion of the test. Part 2 consisted of fifteen items dealing 
with computational skills.^ These were open-ended d^tems. Part 3 contained 
thirty, multiple-choice exe^cise^. 

' p 
3.2 Description of the Population . 

The Grade/Year 4-Mathematics Assessment was designed for all students 
enrolled in their fourth year of schooling. According to statistics 
released by the Ministry of Education, 36 540 chip.dren were enrolled at 
that level as of 28 February 1977, .The Mathematics Assessment test was 
written by 35 277 students, or 96.5% of the total. This falls well within 
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the normal range ijf attendance at this grade level* The best information 
available from the Ministry of Education is that 6% absenteeism is the 
amount that may be expected of, any given day at the elementary school 
level ♦ 

3.2.1 Digtribution by Sex 

Approximately one thousand more, boys than girls took part in the 
assessment. Overall, as is shown in Table 3-1, 51.1% of the , respon- 
dents were boys while 4a^3% were glrl^. This slight preponderance of 
boys was repeated at the Grade 8 level, but reversed at the Grade 12 
level. 



Table 3-1 
Grade /Year ^ Sex of Respondents 



Sex 


Frequency 


Percent 


Male 


18 046 


51.1 \ 


Female 


17 053 


48.3 I 


No response 


175 


0.4 


Multiple response 
< 


3 


0.0 

< 



3.2.2 Age 

The assessment instrument was administered during the month of 
March 1977. At that time, students who were age 6 at the time of 
their enrollment in school should have been either 9' or 10 years old* 
The data presented in Table 3-2 show that the vast majority of stud- 
ents at the Grade/Year 4 level do fall within the normal range ^f- 
ages expected. ^ 



Table. 3-2 
Grade/Year 4: Ages of Respondents 



Age 



Frequency 



Percent 



7 or younger 

8 

9 
10 
11 

12 or older 



121 
1 359 
20 768 '\ 
10^87 
1 537 
149 



0.3 
3.8 
58.8 
31. 1 
4.3 
0.4 



No response 356 


1.0 


/ *• 


■ J- 
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3»2.3 Number of ^Schools Attended 



35 



The resi4ts of this item attest to the high degree of mobility 
thft exists among the families of British Columbia since the number 
of^chools attended by a child 'is highly correlated with Jjwt number 
of residences In which the child has lived* Slightly more than 11^ 
of students at the Grade/Year A level had at the time of .'this ass-;^ 
essment already attended at least four schools since they en'rolled 
in Grade 1. Less than half the, population had been in only one 
school since the beginning of Grade 1. 





Table 3-3 






Grade/Year 4: 


NumbeT of Schools Attended 






Nun±)er 


Frequency 


Percent 


C 


. 1 


15 694 


■ 44.4 




y 2 


10 021 


28.4 


i 


« 3 


4 944 


- 14.0 




4 or more 


3 974 


11.2 




No response 


388 


1.0 




Multiple response 


. 256\ 


' 0.7 ■ 





3^2^A' National Origin and Languages Sppken 

The data obtained regarding students' country of origin (see 
Table 3-4) must be interpreted with caution because of the large 
number of children (ovef 13% of the total) who failed- to respond. 
This lack of reisponse may be due to the students not knowing in 
which country they were b^n. In any event, the data indicate that 
approximately 75% of the^^ftudents enrolled in Grade/Year A are of 
Canadian origin. - # . ^ ^ 

^ 'Table 3- A 

Grade/Year A: Country of Origin — ^ 



Country 



Frequency 



Percent 



Canada 26 215 

Other A 389 

No response A 661 

Multiple response 12 



75.3 
12. A 

13.2 
0.0 
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Students were asked' to respond "Yes" or "IJp" to the question* "Is 
English the language usually spoken in your home?" The results 
presented in Table 3-5 indicate that^-approximately 15% of the 
Children at this level have some language other than" English as a. 
first language. This compares to a rate of approximately 10% at 
the Grade* 8 and 12 levels as determined by the Reading Assess- 
ment which was administered during the same' week as the Mathe- 
matics Assessment. ^ ^ 



Table 3-5 \ 
Grade/Year 4: Language Spoken at Home ^ 



Language 



Frequency 



Percent 



EngMsh 


29 


596 


83.8 • 




Other 


5 


2 35 


' 14.8 




'^0 response 




394 


1.1 




Multiple response 




52 


,0.1 
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3 -2,. 5 Television Viewing Patterns \ 

in response to the question "About how many hbur^s of tele- 
vision do you watch on an average day during the week?", approxi- ' 
mately one child in every three at the Grade/Year 4 level indicated 
watching five or more hours of television per day during the week. 
The same question was asked of Grade 8^ and 12 students on the Read- 
ing Assessment insti^uments , <and their results indicate that about 
25% of Grade 8 and 7% of Gl^ade 12 fitladents spend that much time view- 
ing television. ^ 



Grade/Year 4; 



Table 3-6 
Hours of 'Television Watched ^er uay 



Time 



Frequency 



•Percent 



Usually none 1 396 

Less than 1 hour 1 383 

About 1 hour 3 013 

A^out 2 hours 5 843 

About 3 hours ' 6 791 

About 4 hours 5 949 

5 hours or more 10 902 



' 3, 
3, 
8, 

a 6. 

19, 



i6.8 
30 . 9 , 



/ 
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These data mean that 30% of our children are spending at least as 
much time watching television on a weekday as they are spending in 
school. A great deal of research is' needed if we are to understand 
and deal witl) t^e implications of this activity which consumes an 
•enormous pa^t of our students' out-of -^school time. Some recent 
findings such a^ those reported by Language B.C., indicate that watch- 
ing an excessive amount of televi*sion is associated with poor perfor- 
mance in reading. ^ ^' 

3.2.6 JIand-Held Calculators 

The hand-held calculator is the latest in a series of teaching"^ 
and learning aids which seem to hold^omise for the improvement of 
students' achievement in and understanding of mathematics. A good 
deal of research interest in the field of Mathematics Education is 
currently focused. upon an examination of the effect of the use of 
hand-held calculators in the mathematics classroom. 

A. 

As part of ^ the Mathematics Assessment, students .at all three 
levels jnvolv^, 4, 8 and 12, were asked several questions concern- 
ing their use\ of hand-held calculators. Their responses to these 
questions are summarized in Table 3-7. 
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Table 3-7 
Use of Hand-Held Calculators 



\ 




Responses in Percent 


Category of Use 


Grade 4. 


Grade 8 Grade 12 


Have never used a calculator 
Have used 3 calculator at home 
Have used a calculator for homework 
Have .used a calculator in school 


23.3 
49.9 
12.8 
3.0 


question not asked 
35.1 -50.6 
28.9 55.7 
10.1 51.2 



The fact that only 3% of children in Grade/Year 4 haVe used a 
calculator in school may be indicative of the fact that educators 
are' not convinced of the advisability of using calculators with 
students at this level. 

3^3 Test Results; Computation and Knowledge Domain 

As discussed in Chapter 2, the sixty-nine items on the Grade/Year 4 
test were divided among three domains: Computation and Knowledge (40 
items). Comprehension (17 items), and Application (12 items). Each domain 
was sub-divided into a number of objectives and items were generated to 
measufTlnastety of the objectives. In this isection, the results from the 
Computation and Knowledge domain are discussed, objective by objective. 
For ej^ch objective, the following information is provided in tables: the 
number of the item or items from the test, the percent of students who 
obtained the correct answer, and the judgment of the Interpretatioh Panel 
concerning the acceptability of .the result. 
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The term 'basic facts' refers to sums and products of pairs of 
single digit, whole numbers, as well as to their corresponding diff- 
^ erences and quotients- Thus 9+7=1$, 14 -'6 = 8, 6 x 4 = 24, and 
48 T 6 ^ 8 are basic facts, whereas 11 i+ 5 = 16 , 14 - 3 = 11, 
12 X 7 = 84, and 45 t 3 = 15 are not- 1 ' 

According to the current Curriculuih Guide for Mathematics, stu- 
dents are expected to have mastered all iof the basic fa"ctK for addit- 
ion and subtraction by the end of Grade ,3, as well as those' basic 
facts for multiplication and division wifh products or dividends 
less than 50. To assess attainment of t^is goal, students were given 
four minutes to respond to twenty-four basic fact items, si:^ items 
for each operation. .The results obtained are presented in table 3-8. 

Table 3-8 

C . Grade/Year 4 Results (N = 35 277) 

Objective: Mastery of Basic Facts (mean = 88.3%) 



Item Nos. 



Operation 



Percent 'Correct 



1-6 Addit;ion 

7-12 Subtraction 

13 - 18 Multiplication 

19-21 Division 

22 - 24 Division 



96.6 
92.6 
88 
79 
73 



Panel Judgment 



Strength 

Very Satisfactory 
Very Satisfactory 
Satisfactory 
Marginally Satisfactory 



n:he Panel members were pleased with the results for the first 
three^^perations, but less so with the division results. <They said 
that the lower performance in division might be due to sev^'eral factors 
such as the difficulty of^division, or the placing of the division 
items last. Some Panel members expressed concern about the emphasis, 
on division facts in the primary grades, since many children sStl 
require concrete materials as an aid to soluti<^. 

The ^facts^thafr division is the most difficult of the four basic ^ 
operations and that it is the last of the four operations to be in- 
troduced are probably among the reasons for the Mower performance of 
students on the division basic fact items. ^ It 'is also possible that, 
despite the fact that students were given ten seconds per item on 
this part of the test, many of them faiX^d to get as far as the div- 
ision items. Tne average percent of no Response went from virtually 
zero on the six addition items to 2% for subtraction 6% for multi- ' 
plication and about 18% for division. It should be noted, however^ 
that it is not possible to tell from these data what factor or factors 
were the actual cause ,of the lower performance in division. 
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3.3.2 Addition of Whole Numbers 
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The Vest contained five items to assess students* ability to 
find the scm of two or more whole numbers. Four of the five .items 
required students to regroup (carry)' at least once. 



Table 3-9 
Grade/Year 4 Results (W = 35 277) 
Objective: Addition of Whol^ Numbers (mean = 87. ( 





Item No. 


J 


Percent Correct 


Panel Judgment 




26 




/ 92 


Very Satisfactory 




28 






Satisfactory 




29 




Very Satisfactory 




32 ■ 




84 


Very Satisfactory 




38 




89 


Very Satisfactory 





The Interpretation Panel was very satisfied with these results. 
.They expressed the opinion that Item 28 could have been classified 
with the Applications items rather than the Computation and Know- 
'ledge ones. 



Item 2& and the response rates expressed as per 
in Figure^ 3-1. 



o^nts 



s are. shown 



(28) Add: 



\ 



Responses 



Percent 



$ 3.06 

to.oo 

9. 14 
+ 5.10 



$2730 



2730 



\730 
Oth^er 

No Response 



14% 
2% 



Figure 3-1 \ 
Grade/Year 4: Item 28 \ 



ict ami 



The correct amswers are underlined. 
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1. 



4 



40 



Tb€ results for this item show that 80% of students oBtained the 
correct numerical answer but that orvly 52% included the dollar sign^ 
Unfortunately, tAeyfe is no data available concerning students.' in- 
clusion or non- inclusion of the decimal point in their answer. «>This 
pidce of information was not keypunched. - - 



' . "Overall, the studerfts' performance on the addition items was * 
commendable. There is a considerable amount of evidence that a large, 
p^^centage of students ai^ capable of and do learn how to find the 
sum of two or more whole numhrer^ with a high degree of success. 



3.3.3^ HSubtraction of^Whole% 



umbers 




As in the case of ad^itio^, ' the test contained five items ^ deal- 
ing with, subtraction of whole numbers. Of these, three items 
qid.red students to regroup (borrow) ^t least once. 

* Table 3-10 I ' 

Grade/Year 4 Results (N = 35,27A) ' ^ ' 

Obj«ctive^: -Subtraction of wliole Numbers (mean ^ 74.8^) 



'Item No. 



'Percent Correct 



Panel Ju^gpwfv^r 




30) 
33 
36 
39 



90 
72 
87 
56 
69 




\ Very Satisfactory 

Marginally Satisfactory 
Satisfactory 
Weakn^. ^ / 
Marginally Satisfactory 



The Panel found the remits on subtraction with iregrouping" 
items to be rather low. They attrilkited this perfo^ance to the 
difficulty of the place value concepts involved, to tlie difficulty 
of the items, or to th^nsUf f icient availability of manipulative 
materials for teachers- and for students. 
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Itetn 36 involves regrouping when there is a zero in the minuend, 
the most difficult kind of subtractibn exercise. The actual iteih ^ 
and the results axe displayed in figure 3-2. . 




.6/ 
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Learning to use the subtraction algorithm correctly Requires a 
considerable degree of understanding of our decimal numeration ^ 
system. Many students fail to gain^such an unc^erstanding and, as the* 
Interpretation Panel has stated,, teachers need^ to have a quantity of 
appropriate manipulative devices available both for teaching place ^ 
value concepts^and for develop^ing students' abilities to -use algorithms. 
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.<0 * 



r 
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(36) Subtract: ' 



1054 
865 



Responses 


189 


56% 


1811 


6% 


1189 


2% 


289 


4% 


J99 


3% 


89 ^ 


3% 


889^. 


2% 


1011 


1% 


179 


1% 


Other 


18% 


No response 


4% 



* Figure 3-2 
Grade/Year 4: J^tem 36 

It is worth noting here that the most frequent incorrect re- 
sponse to Item 36 is 1811 which is obtained by always subtracting 
the les«?f^r of the two numbers from the greater, thereby eliminating ^ 
the need for any regrouping. A student's train^'of thought here 
might proceed as follows: "4 from 5 is 1, 5 from 6 is 1, 0 from 8 
is 8, nothing from 1 is 1.** It seems clear that a student who can 
begin with one number (1054), subtract a second number (865), and 
end up with a number larger than he started with (1811) lacks an 
understanding of many of the factors involved in the operation of , 
subtraction. 

In summary, although the results of the subtraction items are 
basically satisfactory^ there appears to be a weakness when regrouping 
is required. Such weaknesses are most ^p'arent when one of more of 
the digits in the minuend is zero. ^ . * 

Reoormendatton 3-1: Teachers of mathematics should have access to 
and make liberal use of appropriate manipulative devices for the 
teaching of place value concepts and of operations on numbers. This 
recommendation is equally important at both the primary and the 
intermediate levels. 

Recommendation 3-2: Persons involved in the pre-service or in- 
service education of teachers are urged to emphasize tne importance 
of having students ^ make use of manipulc^ve devices as models for 
matnematical concepts and skills at all times; but particularly 
when such concepts and skills are being introduced for the first 
time . 

3,3,4 Knowledge of Notation and Terminology 

At every level, students are expected to be familiar with 
certain commonly used mathematical terms as well as with the 
symbols used to represent various operations, relationships, and 
quantities. ^ Six items on the Grade/Year 4 'test were designed to 
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assess students' familiarity with such notation and terminol 



ogy. 



Table 3-11 
Grade/Year 4 Results (N = 35 277) 
Objective: Knowledge of Notation and Terminology (mean = 74.8%) 



Item No. 


^ Topic 


Percent Correct 


Panel Judgment 


48 
49 
51 
56 
57 
63 


<>>, = 

odd nos* 
using $ 
telling time 
reading temp . 
metres^ 


76 
67 
88 
88 
81 
• ^9 


Very Satisfactory 
Satisfactory 
Satisfactory 
Very Satisfactory 
Very Satisfactory 
Marginallyo^atis factory 



The Panel felt that the overall performance here was satisfactory." 
They expressed the opinion that the symbols of inequality (Item 48) 
and the definition of odd. numbers (Item 49) were relatively unimportant 
and that Item 63 was quite difficult. ' ' 

Item 63 was one of several items dealing with the metric system of 
measurement. As is shown in Figure 3-3, ib^as a multiple-choice item 
rather than an open-ended one. - ^ 



(63) 5 metres is the same length as: 



Figure 3-3 
Grade/Year 4: Item 63 



Rcs^ponse 


Percent 


50 centimetres 


27 


500 centimetres 


49 


' 50 millimetres 


' 10 


500 ndllimetres 


4 


1 don't know 


7 


No response 


•3 







•^Lte^ 63 and four others were used on all three tests to assess 
familiarity with the metric system of measurement, and the Grade/ 
Year 4 students obviously found Item 63 difficult. This was not 
complexly unexpected, and one of the reasons that the item was in- 
clude? on the level 4 test was to chart the differences in perfor- 
jnance on this item among the three populations tested. At the 
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Grade /Year 4 level it is more important that students measure and 
gain concrete experiences than it is that they learn to convert units 
within the metric system, 

• 

In general, knowledge of notation and termino.logy is relatively 
unimportant as compared with other aspects of the mathematics curri- 
culum. It is more important to be able to find the difference of 
two numbers than it is to know that the. two numbers used are called 
the minuend and the subtrahend. On the other hand, teachers must 
use mathematical terminology and symbolism in their teaching and it 
is important that students understand the terms and symbols being 
used. Perhaps a minimal list of ter:ms and symbols that all students 
should be familiar with needs to be developed and made part of the 
mathematics curriculum, 

Reoormendation 3-3: Educators should attempt taSdentify a list of 
mathermtiQal terms which students should learn as well as a teach-- 
ing sequence for developing such vocabulary. This list and sequences 
should take into account the developmental nature of the acquisition 
of meaningful mathematical vocabulary , 

Tgst Results; Comprehension Domain 

3,4,1 Understanding of Place Value Concepts . 

Six items on the Grade/Year 4 test dealt with understanding of 
place value or numeration concepts. One of these was an open-ended ' 
item (Item 35) whil^ the remainder were multiple-choice exercises, 
• ' 

Table 3- 

Grade/Year 4 Results"^;?*s= 35 277) 
Objective: Understanding of Place Valil Concepts (mean^ 78,2%) 



Item No, Topic Percent Correct Panel Judgment . 

35 'Multiplying by 100 ' 61 Marginally Satisfactory 

44 Counting by tens 91 Very Satisfactory 

45 Value of digit 88 Very Satisfactory 

46 Rounding off 59 Marginally Satisfactory 

47 Largest Aumber 79 Marginally Satisfactory 
50 Number names 91 Very Satisfactory' 

y — ^ ■ — 

The Panel was of the opinion that results on counting by tens > 
(Item 44) and writing numbers (Item 50) were very satisfactory, as 
was naming 'places' (Item 45), However, performance was less satis- 
factory on identifying the largest number (Item 47), and in round- 
ing off (Item 46), , < 



The children's performance on Item 46 requires some comment. 
The distribution of responses to that Item are shown in Figure 3-4: 



(4^) Round off 43 to the nearest ten. - Respbns e i Percent 

'* 30 , 8 

. 50 11 

40 59 

^44. 14 

I don' t ;know 8 

^ < No response ' 1 

Figure 3-4 
Grade/Year 4: Item 46 



It is generally agreed that the skill of estimation is of great 
importance in mathematics. A pupil who is able to estimate can tell 
whether or not his answer is reasonable. To cite an example discussed 
in the previous section, a student who knew how to estimate and who 
did so would not be satisfied with 1811 as an answer to Item 36: 



(36) Subtradt: 



1054 
- 865 



f 

The ability to round off numbers is an integral part of the skill, 
of estimating, and t])e results, obtained on Item 46 should be a cause 
af some concern to teach e.rs. 

The Interpretation Panel felt that the students' less than satis- 
factory performace on this item might be partially due to a lack of ' 
familiarity with the term ' ropnd off, as well^t to a lack of emphasis 
on this topic ip the curriculNi^i, To the degre^that lack of familiar- 
ity with the terminology was a contributing factor to the students' 
performance, the importance of knowledge of terminology is illustrated. 
The term "round off" is the correct, term and there is no concisfer and 
generally used expression which conveys the same mathematical' meaning, 

Reoormendation 3-4: The importance of place value skills and concepts, 
including estimation^ cannot 'be overemphasized. Teachers and those ' 
involved in teachex education shouM stress thk necessity of develop-- 
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ing understanding of place value odndepts by building upon a founda- 
tion of concrete leading expe7?vence. 

3.4>2' Understanding of Number ".Properties 

Students' p(^formance on' this set of four items was most en- 
couraging and, as can be seeft from the rating^s, the Interpretation 
Panel was pleased with these results. 

^ * Table 3-13 

Grade/Year 4 Results (N = 35 277) 
Objective: Uaderstanding of Number Properties (mean = 90%) 



Item No. 


Topic 


Percent Correct Panel Judgment 


27. 

31 

34 

37 ' 


Multiplying' by zero 
Missing minuend 
Adding zero 
Multiplying by one 


90 Very Satisfactory' 
81 Very Satisfactory 
95 Strength 
95 Strength 



Items yr, 3Yy and 37 dealt with the roles of the numbers 0 and 
1 in addition and multiplication. The results show that almost a^l 
students a* familiar with these important concepts. 

The ^nel commented ,that the overall -performance here was one 
of strengt^. They said that although Item 31 was measuring the' idea 
that subtraction is the inverse of addition; it ,is not clear that 
this was the approach used by the' children. Item 31 required- stu- 
dents to solve the equation 

_ 

_ - 3 - 7 

\ 

This is the most difficult type of additive-subtractive open sent- 
ence to solve with respect to the position of the placeholder. 
Thirteen percent of the students cho^ four as their answer to this 
open-ended item. 




3*4.3 Understanding of Measurement Goncep.ts 



Of the five items in this part of the test, four measured the 
ability to choose the appropriate metric measure in si(£ua\ions in- 
volving length, mass, capacity, and temperature. The \iftliitem. 
Item 59, dealt with the concept of area. 



J Table 3-14 

G^de/Year 4 Results (N = 35 277) 
Objective: Understanding of Measurement Concepts (mean = 54%) 





Item No. 








, Topic 


Percent Correct 


Panel Judgment 



59 Area 61 Satisfactory 

61 Length 81 Satisfactory 

\ 62 Capacity 67 Marginally Satisfactory 

64 Mass 25 Marginally Satisfactory 

65 Temperature 32 Weakness 

' J 



Th-e Panelists stated that Item 59 dealt with area and the stu- 
dents*^ performance was deemed satisfactory given the sophistication 
of the concept of a,rea and the limitations qf paper-and-pencil tests. 
The students* performance of the metric measurement items, however, 
was generally disappointing. 

According to the Curriculum 6uide for Mat^matics, these stu- 
dents have been taught the metric system of measurement and only 
the metric system since they ent-ered school. In spite of this, only 
32% chose the appropriate temperature for a sunny summer day (^5° 
Celsius) and only 25% were able to select the appropriate mass 
for a ten-year-old boy (35 Kilograms). On a third item, 67% of the 
children were able to pick the appropriate capacity of a milk jug. 

In each of these Items, only one choice was the reasonabll one. 
The other three* were clearly incorrect to anyone familiar with the 
units involved. The three incor.rect choices of temperature were 
5°C, 55°C, and *85 C; the three incorrect masses were 35 grams, 
75 grams, and 75 Kilograms; the incorrect capacities were 1 milli- 
Vitre, 10 millilitresji and 100 litres. 

The Interpretation Panel felt that Item 62 shduld have made * 
use of the term "carton of milk" rather than "jug of milk". This 
issue was discussed during the development of the test, and since 
milk was then being sold in one- and three-quart cartons, it was 
felt the term "jug" would cause less, confusion. 



The word 'mass' was not used on the test. Although technically 
incorrect, the stem was worded ^as follows: 

"A. ^en-year-bld boy, is likely to weigh: . ."v 
It was deeme^more advisable to run the risk of being criticized' for 
using the familiar word 'weigh' than to use the decidedly unfamiliar, 
yet correct, term 'mass'. t' 



Over the past several years, a great number of in-service 
workshops have been conducted throughout the province at both 
the school and district level. During the same period, schools 
have purchased metric measuring* devices and teaching^aid^. How- 
ever, results indicate there is undoubtedly room for improvement 
as regards the teaching of the metric system of measurement at this 
y-level, 

Reaommandation 3-5: ,The Ministry fof Education and local schooi 
districts should cooperate in ensuring that materials for teaching, 
the metric system are available in all schools. 

Reconfnendation 3-6: Follow-up workshops and conferences designed 
to emphasize the best methods^ materials ^ and techniques to be 
used in teaching measurement should he provided. Such professional 
development workshops should emphisize the importance of students* 
obtaining **hands on^^xperience in measuring in order to facilitate 
tne development of their ability to ''THINK METRIC"* 

3,4,4 Understanding of Fraction Concepts 

Only two test items concerned the development of fraction con- 
cepts. Not a great deal of emphasis is given or should be given to 
fractions in the primary grades, but the Curriculum Guide. does call 
for an understanding of unit fractions (i,e, , fractions with numer- 
ators of 1) both as part of a whole and as part of a set, 

s J 
Table 3-15 • . 
. ' Grade/Year 4 Results (N = 3? 277) 
Objective: Understanc^ng of Fraction Concepts (mean = 57,0%) 





Item No, 




Topic 


Percent Correct 


Panel Judgment 


58 
60 


Part 
Part 


of a set 
of a whole 


60 
54 


Marginally Satisfactory 
Weakness — 



The Panel found these results disappointing. They said that 
Item 58 may have been somewhat misleading but it still was a rel- 
atively 'weak performance, . ^ 



The most pervasive model for fractions is the part of a whole 
model in which a 'whole' is divided into a number of congruent, 
/^)ntiguous parts. For example, a candy bar is divided into four 
^congruent parts, each representing one fourth of the whole candy 
bar. Item 60 (see Figure 3-5) assessed students' understanding of 
this fraction model. 
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(60) Which box is one-fifth (j) shaded?. 



No -Response: 1 




ID 



54 15 

Figure 3-5 
Grade /Year 4f Item 60 



17 



I don't knovy 



Note that 17% chose the situation where the fifth rectanglar" region 
was shaded and that another 15% chose the response where one region 
wa^ shaded and five were not. 



Many children in the intermediate grades are unable to learn 
or t\remember algorithms for computing with fractions. One of the 
underlaying causes of such a disability is frequently found to be a 
lack of understanding of .basic fraction concepts. The results ob- 
tained from these two items seem to indicate that a substantial pro- 
protion of students in^ Grade/Year 4 do not have an adequate grasp of 
the most fundamental fraction concepts. * 

Teachers as well as curriculum developers must realize that 
fraction concepts, even the most elementary ones, are rather spphist- 
icated and that a great many students find the;n difficult. It seei^s 
clear that both models for fractions which have been mentioned here 
need emphasis. It may also be the case that these concepts are 
being introduced to childrerf prematurely. Perhaps if these concepts^ 
were not introduced in the primary grades at all, but instead delayed^, 
until the children , were somewhat more mature, students might compre- 
hend them better and'^'Bjtelop fewer misconceptions. 




Reoommendation 3-7: Educators ^ curriculum developers j and educational 
researchers shoulcT address the problem of the optimum time for H.ntro'^^ 
ducing fraction concepts in the mathematics' classroom hearing in mind \ 
both the children's development level and the sophistication of ^ the 
ideas involved in these concepts. When introductory fraction concepts 
are being developed^ both models^ part of a whole and part of a 'setj 
should be emphasized. 



Test Resulta: Applications Domain 



Che Applications domain, as described in Chapter 2, includes the 
following categories of cognitive behaviour: ability to solve routine 
problems, ability to analyze data, and ability to recognize patterns^. 
Fpr the Grade/Year 4 test, the Applications itfems were collected into two 
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groupings or objectives. Items which were considered to deal with applic- 
ation within -the day-to-day experience of the children were categorized 
as "practical", other problem situations were described as being "comput- 
ational" in nature, ^ 

3,5,1 Solves Practical .Problems • ' 

The six items in this grouping dealt with applications of. the 
concepts of time (Items 40 and 42), money(Items 43 and 55), and .in- 
terpreting graphs (Items 68 and 69), The results, as shown in Table 
3-16, are quite encouraging^ r - ' , 

'1 

- Table 3-16 
GradeVYear 4 Results (N = 35 277) ^ 
Objective: Solve Practical Problems (mean ^ 78,0%) 



Item No, 


Topic 


Percent Correct 


Interpretation 

A-^ 


40 


Time / 


1 77 


Satisfactory 




Time 


49 ~ 


Marginally Satisfactory 


43 


Mon^y 


82 


Satisfactory 


55 


Money 


86 


Very Satisfactory 


68 


Graphs 


92 


, Strength 


69 


^ Graphs 
r 


82 


Ver^Satis factory 



The, Panelists stated that all areas except that tested by Item 42. 
were at least: satisfactory. They felt that perhaps the content of^ 
Item 42 was not relevant to children of this age. They recommended 
^that materials should be available in classrooms to provide practice 
in practical problem solving. 

In Item 42, students were asked to find the elapsfed titrre between 
4:25 pim, and 5:00^^^rrmv^ Twenty percent o| the children subtracted 425 
from 500 and selected 75 minutes as their response. It may be that 
students are not familiar with the notation 4:25 since that is not the 
way in which times are usually denoted in everyday usage. 

Problem-solving represents the highest level of cognitive funct- 



ioning, and these results indicate that a substantial proportlon^of 
children at the Grade/Year 4 level are learning 
and are experiencing succ^^. in that endeavour. 



pit is import£.nt to bear in mind that developing the student* s ability 
to apply the appropriate mathematical techniques in order to solve a^ 
given problem i\s one of the most important reasons for teaching ancl 
learning mathematics. There is no .point in tTeaching children how ^ 
add, subtract, multiply, and divide numbers unless they also learn - 
when to apply these operations. The results reported here indicate a^ 
fairly substantial degree of pT(»gress toward that goal has been attained 
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at the Grade/Year 4 level insofar as "practicar* applidations are 
concerned, ' 

Children require a great deal of practice in problem-solving . 
techniques, and good teaching practice dictates that the problems 
assigned to children should be as interesting as' possible. Pro- 
blems b^sed \ipon local places and happenings are more likely to 
motivate childten than are problems out of a mathematics textbook. 
Teachers of mathematics at all levels would do well to set up 
collections of "real" problems for use with their classes, 

Reoormendction 3-8: Teachers of mathematics should emphasize class- 
room^^ school^ and local situatyions for developing l^reaV^ problem- 
solving experiences which will be relevant to their students, ^ 

3. 5,2 Solves Computational Problems 

The exercises im:luded under tbris heading are t^~se usually 
termed "word pro^ieflrs"* or "story problems". These are the typ^s of 
problems typica^y f^und in school mathematics textbooks, A pro- 
blem situation is described in words, and the student must decide 
what operation or operations are required in orde^r to solve the 
problem, and then perform these operations corjrectly. The results 
obtained on the six items used to assess this objective are summar- 
ized in Table 3-17, 

Table 3-17 
-Grade/Year 4 Results (N = 35 277) 
Objective: Solve Computational Problems (mean = 64,7%) 

Item No , Percent Correct Panel Judgement 

^1 79 Satisfactory 

52 ^ ^ ^9 Satisfactdry 

53 ' . 88 . Strength 




54 ^ 60 ^ • ^ Satisfactory. 

66 ' / 47 > ^^T ^ Satisfactory 

67 . • 75 ' ' ^ ^ Satisfactory 



The Panel rated performance of\^aiJ^' items satisfactory, except . 
53 which was a strength. The low percentage for 52^ was considered 
satisfactory, as the group felt measuremfe^nt rather than corivetsion 
was more important at- this level, Items^^3 and 26 involved the same 
computation and the percent correct on. I'tBxA 53 was only 4% less 
than that, rfn 26, Items 54, 66, 67 were satisfactory considering the 
complexity involved, ;j . 
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Because of the importance of problem^solving in the teaching 
and learning of mathematics, all six of the items for this objective 
are reproduced in Figures 3-6 through 3-8, 



Response % 

The roller coaster has 8 cars 12 12 

with 4 wheels on each car. How many " 2 1 

wheels are there on the roller coaster? 32 79 

( 24 4 

I don't know 2 

No response 1 

'J f ■ - 
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Skana and Hyak are killer whales. 
They live in the Vancouver Aquarium. 
Here is Skana jumping to get a fish. "'"^ 

Response ' % 



- (52) Skana can jump 627 centimetres high.*" 127 centimetres^.|. . . 39 

Hyak can Jump 5 metres high. How much 622 centimetres 23 

higher can Skan* Jump than Hyak? 22 centimetres 14 

632 centimetres.^, .\ . 8 

^ I don't know 15 

Tlo response ^ 1 

(53) On Monday, 185 people shvi the morning 597 ^. 88 

" whale shows and 412 people saw the 697 ^ 

afternoon whale shows. How many people 327 .* 2 

saw the whale shows that day? 373 2 

I don't know 3 

No response 1 

- ■ ' • ' . ' \ 

(54) Yesterday, Skana ate a total of 98 fish in 66 -rrr--^4 

three meals. She ate 32 fish at the first 41 eo 

meal and 25 fish at the second meal. How 155 v-<l5 

many fish did she«at for her third meal? . 57 12 

•; ' • . * I don't know 7 

No response • • 1 

?p- " ^ Figure 3-7: Grade/Y^a52 - Items 52, 53",v 54 



Sam has 51 pop bottles and 8 cartons. Each carton holds 6 bottlei. 



(66) If Sam fills all the cartons, how maf^ 
bottles will be left over? 



Response 



6 
8 
3 



_%_ 

8 
.10 
^7 



14 24 

I don't know 

No respgai^e 1 



(67) Sam col^cted 30 of the bottles. 

His sister. Marie, collected the rest. 
How |3iany\bottles did Marie collect? 



18 
14 
21 



44 ...... .... 

I don't know . 

No response . . 



4 
6 

75 



er|c 



Figure 3-8: Gr3d.e/Yeai5^- Items 66, 67, 



In three cases, problem-solving items were paired with computat- 
ion items involving the same numbers in order to obtain a measure. of ^ 
the extent to which i>resenMng ^n item as a word probl^m^af fetfei the 
success rate* The data relativ\ to -that qpesti^pn are presented in 
Table 3-18. ' ' ^' . ' . ' ^ 

H * 

> Table 3 ^ 18 

Grade Year 4 Results (N ^ 35 277) 



Problem-Solvitig vs.. Computation Items 



Item 

^ r 


number ■ 

** 

Com. 


• Percent 
-'^ P.S. * 


Correct 
Com. 


Required 
CoAputatlon 










: 


41 




79 


86 


' , 4 X 8 fi ^ ■ ' , 


" 52 


33 


39 


. 87 


627' ^^00 












-&3 


26 


' 88 


92 _ 


185 + 412. 

— it. — -t ' 



* P.S. means problem-spliting ' 
• . ** Com. means computation 

In two of the three cases, Items 41 and 53, th%"^mparison of 
results between the problem-solving and the computational items is 
excellent. There is a relatively low decrease in performace attri- 
butable to presenting the item as a word prol)lem. It may be the case 
that reading difficulties account for much of the difference. but 
^tiother plausible explanation might be that some students do not 
know when to apply the operations which they have learned to perform. 
For example, 12% of the ^Itudents found the sum 4 and ^8 for Item 41 
rather than f indittg^lEIie prcrtiuct: 

The rea^son^ for the great difference between the performance on 
Items 33 anc^ 52^ become mor^ evident upon reading Item -32. Before 
students could solve. this Iproblem, they had first to write 5* metres 
as 500 centimetres. This particular skill was tested by Item 63 
(See Figure 3-3) , and only ^9% of the children obtained a^correcTt 
result. In that' Light, 39% on Item 52 is certainly a satisfactory 
perfprmance at least. ^ 

Item 52 iSs^an^^^ample of a^multi-ste^p problem, a^^^e Items 54 
and 66. Such proble ms ar e, of their nature, more difficult than one- 
step problems, and it is not at^ all surprising that the success rg,te^ 
on these problems is relatively low. When the test was constructed", 
certain items which were known toM^e difficult, including these three 
were deliberately included. It would be erroneouj^ to assun^e that 
there^J^ always a direct relationship between the percent correct on 
an item and the degree of acceptability of that, result. For .example, - 
a success, rate of 39%> on Ilem 52 would certafnly be >re^rable to a. 

' — ^ ,54 ■ • 
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success rate of 75% on a basic . fact'dtem or, on, an item measuring 
attainment of a relatively simple skill. 



As was the case with "practical" problem items, the results 
obtained on these six items are evidence that students at the 
Grade/Year 4 level are achieving satisfactorily insofar as problem- 
'solving is concerned. Certainly there is room for improvement, but 
the findings of this assessment indicate that students at the Grade/ 
Year 4 level have attained a reasonable 'degree of ability to cope ^ '* 
with word problems* in mathematics. 

The Interpretation Panel expressed reservatipns about some of 
the art work used on the test, as well as about the use of the names 
of the ki-iler whales at the Vancouver Aquarium in two of^the problems. 
The decision to make extensive use of art work on the test was moti^ 
vated by a desire to make the test booklet as appealing and interest- 
ing to children^ as possible. Similarly, it was felt'that Skana and • 
Hyak were names that were familiar to children in this province. 
These matters were thoroughly discussed and the results of the pilot 
testing, which was done in several locations across the province, 
did not indicate that children had any difficulty with either the 
art work or the vocabulary. ^ 

3.6 Grade/Year 4 Reporting Categories • ' ^ " 

Mathematic^achievement is the end result of the coalescing of a 
great number of^student-based factors, both extrinsic and intrinsic. i 
Attributes inherent in the student, programmatic and curricular vari- J 
ables, as well as the effect of environmental variables sudh as teacher/ 
differences all contribute in varying and largely unknown degree to a f 
given student's overall performance. Of the fairly large ^number of ' / 
such variables which conventionaiywisdom, current educational practice, 
and the endeavors of educational/researchers have , identified as being 
related to mathematics achievemjent, a limited number were selected for 
examination in the Mathematics Assessment. (See Chapter 1, Section 1.4) 

A great deal more information concerning the possib/e relationships 
between certain personal background variables and achievement on the 
Mathematics Assessment test wa^ collected than could pdssibly be re- 
ported in, this volume. A more complete rendering of^the data may be 
found in the Technical Report, wViich is obtainable from the Learning 
Assessment Branch. Researchers or others who wish to have access to the 
original data in order to seek answers to their own questions on issues 
relevant to Athe Mathematics Assessment should also direct their requests 
to the Learning Ass'essment Branch. 

In the Sections wl^ich follow, all of the results reported are based 
upon correlational trends. No attempt has been made to imply that cause 
-and effect re led ionships exist since the Mathematics Assessment wa^-^not 
designed to identify $uch relationships. It remains' for studies designed 
as follow-ups to the present oq4 Lo seek to identify such relationships. 
Thua, while the assessment results show some fairly strong ^relationships 
between use of a hand-held calculator and student achievement, these 



rela'tionships do not Imply that a student's achievement in mathematics 
is determined by or is even influenced by the . vjse ,of " such a device. 
All that can be said on the basis of the* assessment data is that there 
seems to be a relationship between the two variables. Indeed, it may 
be Hhe case that both of the variables are the effect of a common, and 
as yet unidentified, cause. 

For each of the reporting categories discussed in succeeding sections, 
reference is made to the various domains, objectives, and items' evaluated 
in the Mathematics AssesFsment . - For ease of reference, a labelling system 
has been adopted and will be used throughout the remainder of the chapter. 
Each objective has been assigned a code number consisting of two digits 
separated by a period. For example. Objective 2.3 refers to Domain 2 
(Comprehens ion). Objective 3 (Un^derstanding of Measurement Concepts). 
In Table 3-19 which follows^ the right hand column indicates the section. ^ 
of Chapter 3 where the grade/year 4 population results for the apiJropriate 
objective were di^cusse'S. 

. ' Table 3-19 

Grade/Year 4: Code Numbers Used for Objectives 

Code No. ^ ^ Objective LxDcation'of 

. * Population Results 



1. 


1 


la — 

Number Facts ^ 


Section 


3.3.1 


1. 


2 


Addition of Whole -Numbers 


Section 


3.3.2 


1. 


3 . 


Subtraction of Whole Numbers 


\ Section 


3.3.3 


1. 


4 


Knowledge of Notation and Terminology, 


' Section 


3.3.4 


2. 


1 


Understanding of Place Value Concepts 


' Section 


3.4.1 


- 2. 


2 


■^Understanding of Number Properties 
Understanding of Measurement €bncepts 


Section 


3.4.2 


2. 


3 


Se.ction 


3.4.3 


■ 2. 


4 


^ Understanding of Fraction Concepts 


Section 


3.4.4 * 


3. 


1 


Social Applications 


Section 


3.5.1 


3. 


2 / 


Mathematical Applications 


Section 


3.5.2 




3.6.1 









On the background information section of the Mathematics Ass-' 
essment instrument, students were asked -to provide the month j day, 
and year of their birch. The major reason for xollecting this data 
was to spp what, if any, effect a student's age had on his or her 
achievement in mathematics. Previous research has shown that espec- 
ially in the lower grades, there appears to be a relationship bet- 
ween age and mathematics achievement.- 

The data on students' performance by age are presented in two. 
ways. First, in Figure 3-9, a comparison among the four age-groups 
of children at the Grade/Year 4 level who took the Mathematics 
Assessment test is portrayed graphically. Secondly, in Figure 3-10, ' 
a comparison among three groups of students all of whom attained 
the age of nine years during 1976 is made on the basis of the portion 
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of the year 1967 in which they were bom. 

' 9 




OBJECTIVES 

Figure 3-9: Grade /Year 4: Results by Age 



The nine >^ar olds' performance is superior to that of the other 
three groups on each objeotive. It is not unexpected for the eleven 
or older group- to be so much lower tharl the others since the students 
in this group are students whose academ^^c progress has befen retarded 
for one reason or another. This group which numbered 1,686, or about 
five percent of the total, would likely include students from special 
classes and other special programs as well as children whose language 
background was other tJian English, 
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Figure 3-10: Grade/Year 4: Results by Ag 



In Figure 3-10 a bar- graph is used to compare the performances 
of three groups of children in Grade/Year 4 who were born in 1967. 
Instead of making -fcomparisons on each objective, only domain results 
have been shown. 

" 4 

The results shown in Figure 3-10 lend gupport to the thesis that 
children bom earlier in a given year -iiave an academic advantage 
over those bom later in the same year J All of these children^ are 
nine years old and all ar^ enrolled i«r grade/year 4. That is, 
they have been in school for the sarofe length 'of ^time. In spite of 
th^t, children born between JanuaryCand- March 1967 had^*the higliest 
m^n percent correct on each of the'^ten objectives in the three 
domains. The greatest margins in favor of this group were obtained 
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on the following ob^ctives: 

1) Knowledge bf Notation and Terminology, 

^ 2) Understanding of Measurement Concepts, 

' 3) Understanding of Fraction Concepts, 

and. A) Mathematical Applications. ' ' 

3-6.2 Sex Differences * 

• Girls at the Grade/Year \ level obtained a higher mean percent 
correct on five of the ten objectives assessed than did boys. ^Three 
of these objectives were from Domain 1: Number Facts^ Addition of 
Whole Numbers, and Subtraction of Whole Numbers. The other two 
were from Domain 2; Comprehension of Number Properties And Compre- 
hension of Fraction Concepts. Tlje boys obtained higher spores on 
the'other five objectives, one from Domain 1, two f rora-^-Dxannain -2^, ^' 
and both *problem-solving objectives which made up Domain 3. The 
results pprtrayed in Figure 3-11 show that all of the^dif ferences 
were slight. 
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3-6,3 Number of Schools Attended 

The results displayed in Figure 3-12 show uot only that stu- 
dents who have attended only one eletnentary school achieve, higher 
'\ results than others but also that the results .continue to decrease 

with each increase ^in the number of schools attended. This pattern 
holds true for all ten objectives. 
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Figure 3-12: Grade/Year 4 Results by Number of Schpols Attended 
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Further investigation is needed to discover the precise nature 
of the^relationship between number of'schools attended and achieve- 
ment in mathematics. These results seem to indicate a fairly strong 
negative relationship between the two variables, but they cannot 
identify the exact nature of that relationship, 

3-6,4 Use of Hand-Held Calculators 

i 

Students in Grade/Year 4 were asked four questions' about their ' 
use of hand-held calculators; *^ave you ever" used a hand-held cal- 
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culator? Do you ever use. a hand-held calculator at home? Do you 
sometimes use a hand-held calculator at home? Do you sometimes 
use a hand-held calculator to do. your homework? Do you sometimes 
use a hand-held claculator in sqhool? Their performances on the 
test as functions of their responses to these questions are summar 
ized in Figures 3-13 through 3-16,. 



JOO.i 





i 





3.6.5 Number of Hours of Television Watched 

Language B.C. results showed an increase in performance in read- 
ing with an increase in the amount of television watched *uiwto two 
hours per da^, and then a gradual decrease to the four or more hours, 
of television watching^ per day category. The Comparable results for 
mathematics are shown in Figure 3-17. 
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^ Figure 3-17 Grade/Year 4 Results by Dail7 Television Watching 
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In Figure 3-17 the domain results for the Grade /Year 4\studentQ 
are divided into seyin categories on thd? basis of their responses 
to^ the television watching item on the background informationN^ection 
of the mathematics test. ' . \ 

^ Students who watch al^out four hours* of television pier day ob- 
taified the be^^ results in each domain, followed closely! by those 
who watchPa'Sout three hours per day. Curiously, the worst results 
were obtained by students who s^id they watch no television, five 
hours or more, or less than o'ne« hour per day. -Whereas Language 
B.C. noted a general increase up to two hours per day, here there 
is a consistent increase in performance up to four hours per day, 
almost as much time^.as children spend in school. 

'3.6..^ Language Group 

Grade/Year 4 students were ask*^ three questions concerning the 
langua^ges they spoke and national origin: These items are reproduced 
below. ^ ^ 




4. Were you born in Canada? 



Yes : □ 1 

No □ 2 



6. Did you usually speak a language other than 
English before you started Grade 1? 

Yes □ 1 

No 2 

7. Is English the language usually spoken in your 
home? 

>es - □ 1 

No a 2 
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On the basis of their replies to these four items, students 
yere divided into five groups as follows: 

r 

a. Non-Ganadian, Non-English: All Grade/Year U students who 

responded "nol* to item 4, **yes" to item 6, and *'no" to • 
* item 7. . 



<^ b» Canadian, Non-English: All Grade/Year 4 students who res- 
ponded "yes" to item 4, "yes" to item 6, and "no" to item 7. 

c» First Generation Canadians: All Grade/Year 4 students who 
responded "yes" to item 4, "no" to item 6, and "no" to 
item 7. ' i . 

d» Non-Canadian, English: All Grade/Year 4 studentXwho res- 
pondedv"nQ" to item 4, "no" to item 6, and "yes" to item«'7. 

' e. Canadian* English: All Gra^^lSear^^ students who responded 
"y€t§^' to item 4, "no" to item 6, and "yes" to item 7. 

'7 , ^ ^ 

The performace of each of the five groups was computed for each 
domain and th^ey are summarized in Figure 3-18. 
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'Figure 3-18: Grade/Year 4 Results by Language Group 



Th| Canadian, English-spe^Liftg-^roup achieved the highest result 
overall. The results' for the non-English -speaking groups and for 
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68 ^ . . . .J r * 

^ the other two English-speaking grpups were similar ^to each other. 

The First Generation Canadian group's performance lagged .behind. - 

In Domain 3 where morfeT reading and knowledge of notation and 

terminology were required, the^ difference between the English- 

and non-English-speaking groups was greatest • ' ' * . 

The results for Domain 1 show that the non-English-speaking 
^ -groups outperformed ^the English-speaking groups, Unlike^Lang- 

uage B,C,, the avetall performdce^of the two non-Engli^h-sipeak?-. - ' 
• ing groups on the Mathematics Assiessment was about the same as 

that of the Non-Ganadian English-speaking group, *sr 

3, 7 Summary and Recommendations 

The Grade /Year St contained sixty-nine items designed to assess 
students' mastery o*f ten objectives grouf)ed intd'^three domains. In add- 
ition to these mathematics items, the test contained thirteen background ' 
information items' which students were asked to complete before taking J 
the test, * ^ . " 

vT — ^ ^ 

Items 1 - 39 on the Grade/Yfear 4 test were open-ended, Ite.ms^AO - 
69 were multiple-choice exetcises. Students responded to the test items 
in the test booklet itself by either writing the answer for open-ended 
exercises or marking their choice of answer with an "X" for the multiple- 
choice items. The information' from the booklets was then keypunched 
into machine-readable f6rmat, ' \ 

■ ■^^ , . ' . 

One and one-half hours were allotted for Che test: thirty minutes - 
for instructions, distiiibutipn and collection of the test booklets and 
completion of the background information items, -and sixty minutes for 
completion of the test itself. The background intormation items were 
^ministered first, ^Teachers administering- the t^-sr-w^rre asked to .> 
fead each of these items aloud tcT their students and to assist them in 
completing the items correctly, 

. . ^ The test itself was divided into three parts. Part 1 was timed and 
consisted of twenty-four basic fact items, six'for each of the operations 
of addition, subtraction, multiplication, and division,' Student^ were f 
given four minutes to complete this portiop of the test,* Parts'^ and 
3 were not speed tests; students were given one hour to do the items on 
this portion of the test. Part 2 consisted of fifteen open-ended items 
dealing with computational skills. Part 3 contained thirty multJ 
choice exercises, . 



The, Grade/^ar 4 Mathematics Assessment was designed for all stu- 
'deivts enrolled in their fourth ^year schooling, Accordiag to stat- 
istits released by the\inistry of Elation, 36 540^ children were en- 
rolled in Grade 4 as of 28 February, ^1977 , The Mathematics Assessment 
test was written by 35,^7 students or 96,5% of that total. This , " 
f al]^s ^well within the normal range of attendance at this grade level, 
proximately 1000 more boys than glArls took the test* 
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3.7.1 Background Information ^ 

The assessment instrument was administered during the month of 
March 1977. At that time#^ a student should have been either nine 
or ten years -old if he w^s age six at the time of his first enroll- 
ment in Grade 1. About ninety percent of the Grade /Year 4 students 
were within the normal age range expected. 

The results on the item concerning the number of schools attend 
ed attest to the high degree of mobility that exists among the fam- 
ilies of British Columbia since the number of schools attended by 
a child is highly correlated with the number of residences in 
which the child has lived. 'Less than half the population has been 
in only one school since beginning Grade/Year one. • * 

Other background information showed that seventy-five percent' 
of the students are of Canadian origin and 'fifteen percent have a 
language other than English as a first language. Over two-thirds 
of the students watch three hours or more television per day, and 
almost one-third of the Grade /Year 4 students appear to spend as 
much time watching television on a weekday as they spend at school. 

The data gathered on hand-held ^calculators showed that over 
three-fourths ot the students have j^d*^ hand-held calculator, but 
only three percent have used a hand-held calculatc^r in school. 

3.7.2 Test Results 

The sixty-nine items on .the Grade/Year 4 test were divided 
among three domains: Computation and Knowledge (Domain 1, 40 iteiqs) 
Comprehension (Domain 2, 17 items), and Applications\ (Domain 3, 12 
items). Each domain was " subdivided in^ ^ number of objectives 
and the items were generated to measuxe mastery of the objectives.- 

The Grade/Year 4 students' performance on* the items of Domain 
1 was very satisf actq^T^ with only one weakness noted. Goo3 per- 
formances on the items' outnumbered "the poor performances by a two 
to one margin. The nJ^^^Ri weakness was on a subtraction exercise 
that involved both a zeto in the minuend and regrouping. That 
item was "one of the items for Objective 1.3, Subtraction. of Whole 
Numbers. The poorest performace in Domain J^was on Objective 1.3. 
The best performace in Domain One was on 'tha six basic facts for 
addition on, which the average percent correct was 96.6%. 

Other areas where the Grade/Year 4 performance was rated as 
very satisfactory in Domain 1 were subtraction and multiplication 
basic facts, addition of whole numbers, and reading time and 
temperature. / . * 

The Grade/Year 4 students' performace on the itetts of Domain 2 
was mixed, with as many weaknesses as strengths ^bering noted. The 
pattern of pe rf err mance, however, was very cl^ar. Performance on 
both items of Objective 2.4, Understanding of Fractlion Concepts 
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was, poor; and also on three of the |H ve i tems of -Objective 2.3, Under- 
s.tanding of Measurement Concepts. ^ Ir>%i5e-C^ive .2 . 3, less than one- 
third of jthe students could correctl>r^respond with a likely jtemper- 
ature for a sunny summer day.- In Objetitive 2.4, bar-ely half of the 
students could identify the box that was one-fifth (1/5) shaded. 

^- On the positive side, the students performed extrem^ely well on 
Objective 2.2, pnderstanding of Number properties with ninety-five 
percent of the students correctly applying the additive and multi- 
plicative identities and ninety percent correctly applying the 
multiplicative property of zerjo. 

Grade/Y^ar 4 students performed well on both objectives of 
Domain 3 with the performance on two items being rated as strengths 
and no performance rated -as a weakness. Only one item was rated . 
belQ^ satisfactory and four items were rated above satisfactory. 
The poorest performance ,was on -an item involving subtraction with 
time. The performances rated as very satisfactory were on items 
concerning money and reading a graph. The performance on the 
other item involving reading a graph was. rated as a strength, as \ 
was the performance on the word problem involving the addition of 
whole numbers. 

3.7.3 Reporting Categories - • 



HaLhematics achievement is the ejid result of .the coalescing 
of a great number of student-based factors, both ^xtrinsic and 
intrinsic. Attributes inherent in the student, programmatic and 
curricular va^riables, as well as'* the effect of environmen^tal vari-^ 
ables such as teacher differences all contirubte ifi varying and 
largely unknown degree to a given student's overall performance^ * 
Of the fairly large number of such variables which ^he conventional, 
wisdom, current educational practice, and the endeavors of educ- f 
ational researchers have identified as bein^ related to mathematics ( 
achievenae^t, the oneb that were selected for scrutiny in the Grade/' 
Year 4 MauTematic^ Assessment were age, sex, number df schools 
attended, use of hand-held caltiulators , television watching, and 
language. ' . ^ ' 



Age Differences — TKe nihe year^ olds had the highest 'per- 
formance and the eleven 'year olds had the . lowesXyPe^f ormance on ^ 
each of the pen objectives. Considering just /those students who 
turned nine years old during 1976, the t'esults supported previous 
research which s^ys that older children h^'e an'. academic advantage 
ovet their younger counterparts at the same level;. 

Sex Diiferences — Each group perforined*b6tter than, th^ other 
on fiye of the ten ^ob jfectives , but of the five ob ject'dves'^'on 
which the girls obtained the higher jperf ormajjce thr.ee we-re in Dei- 
main 1. ^ » ' . , . 

N<imbe,t^Qf Schools' Attended ~ Tho^ Grade /Year 4 stuudits^ who \ 
had attended only pne school performed better than all the cttfier ^ 
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groups on every objective. The pattern exhibited was that the fewer 
schools attended; the higher the performance. The pattern held for 
all ten objectives, * • .) 

Use of Hand-Held. Calculators — Two distinctly different patterns 
were noted in the data collected on the foui^questions concerning 
the use of hand-held calculators. Students who had used hand-held 
calculators' achieved better results on each of th^ ten objectives 
than those students who had never used hand-held calculators, ^The 
same pattern held on every objective for those students responding 
that they used a calculator at home compared to those who had xjever 
used a hand-held calculator at home. The peifformace pattern was -J^ 
reversed for thpse students who had used a hand-held calculator for 
homework and for those students who had used a hand-held calculator 
in school. 

Television Watching — The general pattern was that the more 
'hours of television watched up. to four hours per day, the higher 
the performance. However, the differences were small, 

LaTiguage — The Grade/Year 4 data were grouped according to- 
whether the students had been born in Canada, whether they usually^ 
spoke, a language other than English before starting Grade I, and 
wheth-er English was the language usually spoken in the home,^ The 
average performance of the Canadian, English-speaking group was 
n^^st of the five groups. T^e^ two non-English-speaking groups 
pierformed equally as well as the non-Canadian English' speaking groups 
and this was a rather surprising result. The first generation 
Canadian group* s performance lagge^i behind, 

« 

3,7T4 Recommendations 

Based 9n the data presented in this chapter, the following 
recommeniiat ioni were, made, > 

h Re^comynendqtion:-3-2 ^ Teachers of mathejnatics should have access to 
^' ayid^rnake ^li]Jeral>iiS£^of appropriate manipulative devices for the 

teaching^ of place^ vali^ concepts and of operations on numbers, 
tThis recommendatiah is^^equullt^ vmportant at both the primary and 

tne intermediate levels, • * ^ * 

Recc^mmendation 3-2: P.^^on^^ involved .in the pre-service or in- 
sevvici" ediicatZon of teachers are^urged to emphasize the importance 
of^riavin^ student^ make uee of manipulative devices- as models /t?^- 
mathemattcal concepts and skills at all^timeh^ but particularly 
when suclr concepts and skills are being introduced for the first . 
tfxe\ / ' ' ' 

. ' Recommendation -3-3: -Educators should attemipt ^to' identify a list of 
mathematical terms which ^tud^ts ^j^uld learn 'as well as' a teach-^ 
fiiyj sequence fo^ developing t(iis^vocahulary . ><>The list and sequertce 
j^ouhd take' inta account ^h^-jdevelopmental natiire of\the acquisition 
^of meaning ul ^mathematical wcahulary. ' , \ 
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Recommendation 3-4: The importance of place value skills and concepts j 
including 'estimation, cannot be over-emphasized.' Teacher^ and those 
involved in teacher education should stress the necessity of develop- 
ing understanding of place value concepts by building upon a founda- 
tion of concrete learning experiences. 

Recommendation 3-5: The Miy/Tstry of Education local school districts, 
and professional associations should cooperate in ensuring tHat 
materials for teaching the metric system of measurement are, available 
in all schools, • ^ ' 

Recorrmendation 3-^6: Follow-up workshops and conferences, desired 
to emphasize the best materials^ methods, and techniques to be used 
in teaching measurement sh^ould be provided. Such professional * 
development woi^shops should , emphasize the importance of studenis* 
obtaining *'hands-on^^ experzfnce in measuring in order to facilitate 
the development of ^theiv civility to '^THIlfK' METRIC" , 

Reco^nendation Z-7 : Educators, curriculum developers, and educational 
re sr archers ^should address the problem of the optimum time for intro- 
aucing fraction co^.cept^ in the 'mathematics classroom bearing in mind 
both the children's de^velopmental level and the sophisticdti(on of the 
ideas involved in these concepts. When introductory fraction concepts 
are being developed, both models, part of a whole and part of a set, 
r^hould be emi^nasized. 

Recommendation 3-8: .Teachers of mathematics should emphasize class- 
room, school, and local situations for developing '^reai^ problem- 
solving experieyic'es which will ^be relevant to their ^udents\ 
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t 'Chapter 4 
Gfade 8: Results, Interpretation, and Recommendations 
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The results of ^he assessment for the Grade 8 level are presented 
in this chapter, organized by domain and objective . Specific items are 

T)resented when an illustration is needed for the discussion of an ob- 
jective. Due to space limitations, it has not been possible to present - ' 

'and discuss each item. More detailed information concerning each item 
is presented in Report Number 3: Technical Report. 

4. 1 Description of the Test 

The Grade 8 test has sixty content items measuring acquisition of 
twelve objectives in three domains*. ^In addition to the content items, 
the test contained ten items dealing with student background information. 
Both the content and background items were presented in the multiple 
choice format. Every content item had five foils or distractors. Four 
of the distractors were possible answers while the fifth distractor was 
"I don't know". Students responded to the test items by marking their 
responses on a mark-sense card which had been specially designed for 
the Grade 8 Mathematics Assessment-. 

• 

Pilot testing of tlie Grade & test was carried out in several schools 
across the province (see Appendix B for a list of participating schools). 
The main purposes of the pilol testing were item verification and timing 
since the instruments of the Mathematics Assessment were not designed to 
be speed tests. The results of the piloc testing showed that a majority 
of th^ students had completed the test ii^ forty minutes ^ and virtually 
every student was finished in fi/ty-five minutes. A total of ninety min- 
utes was allowed for the entire assessment: thirty minutes for the distri- 
bution of tests, instructions, completion of background items, and collec- 
ting of tests; and sixty minutes for the students^to respond to the content 
items. ^ 

A. 2 Description of the Population 

J The Grade 8 Mathematics Assessment was designed for all students en- 
rolled in Grade 8. According to statistics released by the Ministry of 
Education, 46 888 students were enrolled ^t that level as of 28 February . 
1977'. Usable mark-sense cards were obtained from 42 250, or 90.1% of the 
total. The best information available from' the Ministry^ of Education is 
that 8.1% absenteeism is the rate th^at may be expected on any "given day ' 
at the junior secondary level. This figure is considered by many to be a 
conservative estimate of the actual rate. - ^ 

4.2.1 DJrstribution by Age 

The assessment test was- administered during the month of March 
1977. At that time a student who was six years old at ^e time of 
his enrollment in grade one should have been either thirteen or four- 
teen years old. The , data shown in Table 4-1 show that over 90% of the 
Grade & students do fall within the nojrii^^ range of ages expected.. ^ 
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Table A-1 
Grade 8: Age of Respondents 



Age Frequency Percent 













10 or younger 


36 




0 


0 


11 


39 


V. 


. 0 


0 


12 


682 




1 


6 


13 


• 24 075 




,56 


.9 


14 


14 237 




33 


6^ 


15 


2*344 




5 


5 


16 


376 




0 


8 


17' 


64 ' 




* 0 




No response ^ 


397 


/ 


0 





A. 2. 2 Distribution by Sex ^ y^^^ 

y As mentioned in Chapter 1, differences in achievement levels 
between boys and girls have been of interest to educators for some 
time. The Grade 8 level ha^ been mentioned in the research litera- 
ture as the approx:^mate poiat where boys begin to achieve higher 
scores than "girXs with respect to mathematics achievement at the * 
higher cognitive behaviour levels. ^ 

\ 



Table A-2 . 
Grade 8: Sex of Respondents 





Sex 


Frequency 


Percent 


Male- 
Female 

No response * 
Multiple response 


■21 470 ^ 
20 162 - 

537 
81 


50.8 
47.7 

1.'2 
0.1 



T 

Approximately 1300 more males than females took part^in the 
assessment. Overall, as is shown in Table ^-2, 50.8% of the res- 
pondents were boys while A7.7% were girls. This slight prepor^der- 
ance of boys also existed at the Grade/Year A level, but was re- 
versed at the Grade level . 



4.2,3 Number of Schools Attended 



77 



The results 6f this item attest to the high degree of mobility * 
that exists among the families of British Columbia since the number 
of schools attended is highly "correlated with the number of rl*sidences 
in which the child has lived. Almost one out of every four (23%) Grade 
'8 students in 'the province has already attended five or more schools. 
Less than a third (32.7%) of the Grade 8 students have attended only 
two schools, presumably one elementary school and one secondary school . 
Such a low percentage cannot be supported by saying that during ele- 
mentary school many student attended two schools, a primary school or 
annex and an intermediate school, since such schools represent only 
2.5% of the elementary schools in the province. 



Table 4-3 
Grade 8: Number of Schools Attended 





Number of Schools Attended 


Frequency 


Percent 


/ 
/ 



1 

2 
3 
4 
5 
6 

7 , 
8 - % 
10 or inore 

No response 



1 367 
12 479 
11 124 
970 
055 
236 
1 291 
1 217 
1 096 

415 



6 
•4 
2 



3.2 

29 .-5 

26.3 

16.4/ 
9.5 
5.2 
3.0 
2.8 

'2.5 

0.9 



4.2.4' Hand-Held Calculators 

The hand-held calculator is the iatest in a series of teaching 
and leajrning aids which seem to hold promise for the improvement of 
stydents' achievement in and understanding of mathematics. A good 
.deal of research interest in the field of Mathematics Education is 
currently focussed upon an examination of the effect of. thfe use of 
hand-held calculators in the mathematics classroom. C » 

As. part of the Mathematics A^^ssmenr, student^ at all t|ir^e 
levels invol\>ed/ were asked several questions concerning their use of 
h^nd-held /Calculators, Their respgfises to these questions are sum- 
marized in Table 4-4. 
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Grade 8: Use of Hand-Held Calculators 



• Category of Use Grade 4 Grade 8 Grade 12 

^ 

Have never used calculator in school 23,3 Question not asked 

Have used calculator at fiorne 49,9 35 .-l 50^6 

Have used calculator for homewor^ 12,8 28.9 . 55.7 

Have used calculator in school - 3.0 10.1 51.2 



The data shown in Table 4-4- reyeal three very interesting re- 
sults. First, as students go throi/gh the grades in British Columbia 
schools more of them use hand-held calculators in school and for, 
homework^. Secondly, a smaller percent of Grade 8 students use a' — 
hand-held calculator at home than either of the other two. levels 
tested. ^Thirdly, the percent of Grade 12 students using a hand- 
held calculator in school is over five times greater than in Grade 
8 . J * 

The fact tha^ only 3% "of children in Grade/Year 4 and only 10% 
of the students ib Grade 8 have used a calculator in school may be 
indicative of the fact that educators are not convinced of the ad- 
visability of .using calculators with students at these levels. 

' . ^ a' 

4.2.5.* School' Organization 
* ^ — ; -yr ' 

Whether a secondary school is semestered or not' is a major 
. factor in determining the organization of the mathemj^tics teaching. 
As the data in Table 4-5. show, however, fewer than one third of the 
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de 8 students havt. tak^n a semesjtered version of Mathematics 8, 

Table 4-5 

Grade 8: Semestering of Mathematics Courses 



Frequency 



Percent 



Semestered 
Non-Sem^tered»- 

No resp&ns^ 
Multiple response 



12 865 
28 799 

470 
116 



30.4 
68.1 

1.1 
0.2 



1 



4»2.6 Mathematics Background 

Not every student enrolled in Grade 8 takes Math 8. Some 
students follow accelerated programs while others may still be 
taking Grade 7 mathematics. The results' displayed in Table 4-6 
show that the overwhelming majority of students at this level, 
87.5%, are taking Math 8. The 6.7% who are not taking mathematics 
probably are enrolled in semestered schools and completed their 
mathematics cours^e in the first" semester . 

- ■ .0 

Table '4-6 > 
Grade 8: Mathematics Background 
C^J \ 



Course 



Highest Course Completed 
Frequency , Percent 



Current Course 



Frequency 



Percent 



Mathematics 7 


34 


050 


80.5 




733 


1.7 


Mathematics 8 


6 


077 


14.3 


37 


000 


87.5" 


Mathematics 9 




IS 9 


0.4 




480 


1.1 


Other 




880 


2.0 




625 


1.4 


None 




0 


^ 0.0 


2 


877 


6.7 


No response 




665 • 


1.5 




362 


0.8 


Multiple response 




379, 


0.8 




184 


0.4 



A,2.7 Mathematics Homework ^ 

^ The data in Table A-7 shows that one. out of every seven Grade 
8 students spends no time at all on mathematics alignments outside 
of regular mathematics class.' Fewer than one out of every three 
Grade 8 students spends more than thirty minutes on mathematics home- 
work. . . • . o 





Gra'de 8: 


Table A-7 
Mathematics 


Homework 






Amount of Time 
on Mathematics 


Spepk 
Homework 




Frequency 


Percent 



None at ^11 '0 
Less than. 30 minutes "p^ 
30 - 60 minutes per day 
More than 60 minutes per 

No response 
Multiple response 




6 238 
23 '346 
10 802 

1 237 

525 
102 



14.7 
55.2 
25.5 
2.9 

1.2 
0.2 



80 



4,3 Test Results; Computation and Knowledge Domain 



As discussed in Chapter 2, the sixty items on the Grade 8 tests were 
divided among, three domains, and each domain was -sub-divided into a. number 
of obiectives. In this section, the results from the Computation and^ 
Kn5>i^!redge^domaift are ^i^cussei, objective by objective. 

The Computation and Knowledge domain encompassed six objectivas, 
mastery of which was measured by thirty-two items. For each objective 
of each domain, the following information is provided: 

1) the number of the item or items from the teat; 

2) the percent of studei^ts who obtained the correct answer to each item;- and 

3) tjie judgment of the Interpretation Panel concerning the acceptability of 
the result,, 

0 

4.3.1^ Computation with Whole Numbers » * 

By the ^nd of Grade 7 students are expected to be able to per- 
form the four tasic operations of addition, subtraction, multiplication, 
and division on several different sets of numbers. This expectation is 
reflected by the objectives in this domain. The most basic computation 
is with whole numbers. The results^of the five items used to measure 
acquisition of this objective are< presented in Table 4-8, \. 



Objective ; 



Table 4-8 ' \ 

Grade 8 Results (N = 42 250) 
Computation with Whole Numbers (mean = 83,8%) 



Item ^o. 



Operation Percent Correct 



Panel Judgment 



-4 
8 
16 
32 
49 



Addition ^ 93 

Division 70 

Subtraction 89 

Addition 88 

Mul t ipl ica t ion 7 9 



Vety Satisfactory 
Marginally Satisfactory 
Very Satisfactory 
Very Satisfactory 
Satisfactory 



The Interpretation Panel Expressed the opinion that the results 
for trfis objective were very satisfactory with the exception of division. 
The mean of 83,8% for this objective is impressive. Combining a high 
overall mean for the objective with the fa^t that division is the most 
difficult of the four basic operations and that it is the last of the 
four operations to be developed in the elementary curriculum leads to 
fthe conclusion tHat the Grade 8 'level students' performance on compu-- 
tati^lk'with whole numbers was encouraging, . ^ 



:i4||*wi 

% 



ERIC 



79 



4.3.2 Computation with Fr^tions 



The test contained four items to assess the students' ability 
to perform the four basic operations using rational ^numbers ^ in frac- 



tion form. The results for the four items are 



' Table 4-9 
Grade 8 Results (N •= 42 250) 



found in( T^W^ 4-9, 




»jec-tive: Computation with fractions (mean = 68.2 






T - 






^^"1 — 

Item No. 


* 

Operation . 


"Percent Correct 


Panel Judgment 



2 
6 
11 

2-9 



Addition <» 66* 

Subtraction 63 

Division 62 

Multiplication 82 



Marginally Sat-isf actory 
Marginally Satisfactory 
Satisfactory 
Very Satisfactory 



81 



The Interpretation ^'anel's comments with respect to the results 
presented in Table 4-9 were t;hat the students' performance was generally 
satisfactory, with no particular weakness evident in any of the opera- 
tions. The Panel recognized that operations with fractions are diffi- 
cult and this resulted in lower performance. 

The multiplication algorithm for rational numbers in fraction 
form requires the fewest steps of the four operations and the perfor- 
mance reflects this^fact. The division algorithm, however, requires 
fe^er steps than either the addition or subtraction algorithms for 
Vration^^ numbers in fraction form with unlike denominators and the , 
performance does not reflect tKt^^^f^et^ Instead of applying the "invert 
and multiply" process, 15% o5 the students simply multiplied. 

Items 2 and 6 were exercises involving unlike denominators. For 
Item 2, an addition problem, 19% of the students simply added the numer- 
ators and added the denominators. For Item a subtraction problem, 
22% of the students simply subtracted the numerators and subtracted the 
denominators. Thesj^^^rors on Items 2 and 6 represent 58% and 69^^^ 
respectively, of the students ^king errors. Stud^nls making these 
types of errors do not show an understanding of t,he processes of adding 
and subtracting, rational numbers in fraction form. 

4.3.3 Computation with Decimal 

As ^discussed in Chapter 2, the emphasis in the Computation and 
Knowledge Domain for Grade 8 was on computation with different sets 
of numbers. The results for Computation with Decimals are presented 
in Table 4-10. ' 
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Table A-10 
^ade 8 Results (N = 42 250) 
Objectjvey Computation with Decimals (mean = 67.6%) 



Item No. 


Operation " 


Percent Correct 


Interpretation 


1 


Subtraction 




Satisfactory 


5. 


' Multiplication 


63 


Marginally Satisfactory 


15 


Addition 




Satisfactory ^ 


17 ' 


Subtraction 


f6 


Satisfactory 


28 


Division 




Marginally Satisfactory 



The Interpretation Pan%l felt that the students' performance 
was generally satisfactory. The Panel continued by emphasizing that 
in view of the implementation of the rietric system^ of measuremerit, 
decimal computation is becoming more important. 

One factor that may have affected the performance level was 
formaO of the items. The .addition, subtraction, and multiplication 
problems were presented in hqr^izontal form which is considered more^ 
difficult than the vertical form (e,g7. Item I was presented in the 
form on the left €n Figure 4-I/as opposed to the. form on the' right). 



Horizontal 
62.1 - 23.8-= 



Vertical / 

6.2.1 
- 23.8 



Figure A-1: Hofizontal and Ver 



tical Format 



A factor involved in the difference in performance between 
Item I and Item 17, both subtraction problems, is that Item 17 was 
"ragged alignment** problem, In^ such an exercise, one of the two 
numbers is presented with morjs^ d'igits to the right .of the decimal 
point ^han the other. Before students can do a ragged alignment 
exerclse,\^th^y must correct the alig^r^ment by either physical^ly or 
mentally placing zeros in the appropriate places,, 



> 



Tie commendation 4-2 : Due to the increasing importance of the decimc 
form- of rational numbers^ all teachers of mathematics should take special 
care to lay^^^thej^ufidation for understanding of the expansion of the 
numeration system to the decimal form for rationa'^ numbers . Under- 
standing o'f the decimal form of rational numbers should th^n be used 
'to improve performance with the^our basic operations usint the deci- 
mal form of rational numbers. " * 

Recommendationj 4-2 : In future materials produced by, authors afui currz- 
culum developers y the decimal form of rational numbers should precede 
the fraction form. The overall curriculum should place^m^ch , greater 



emphasis ^on the decimal form. 
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4.3.4 Knowledge of No^tion and rtenninology 



/ 



At eyery level students ate expected to be familiar with certain 
ccAimonl^ used mathematical terms as well as with the symbols use^i^ to - 
represent various operations, relationships and quantities. Nine irems 
on the Grade 8 test were designed to assess students' familiarity w-ith 
-such notation .and terminology* Resufts for the nine items are presented 
in Table 4-;i. . ' ^ 

\/ ^ ' 

Table ^11 > . ' 

Grade 8 Results C*I = 42 250) 
Objective: Knowledge of Notation , and Terminology (mean = 70.8%). — ^ 



Item No. 


Topic 


Percent Correct 


Panel Judgment 


3 ^ 


Square root 


51 


Marginally Satisfactory 


7 


Factor 


78 


Very Satisfactory 


9 


Powers of 10 


. 73 


Satisfactory 




€^^&ntimetres 


69 


Satisfactory 


30 


Exponents 


72 


Very Satisfactory 


33 


Whole Number 


88 


Very Satisfactory 


34 , 


G.C.F. 


73 


Very Satisfactory 


44 


Reciprocal 


' - 80 


Very ^tisfactory 


45 

V 


Primes 


53 


Marginally Satisfactory 

4 ' 



The Interpretation Panel commented that the students' performance 
on this objective w^s, with the exception of Items 3 and 45, very satis- 
factory. The^Panel did not have great coi^cern about the low performance 
on Item. 3, since square root is^well covered in Math 8. It , should be 
noted however, t^hat the '*I don't know" response was selected by 13% of 
the students on' Item 3, the tffird highest ranking for that response on 
the entire test. ^ >^ ^ * 

' ' ' 4' ' 

For Item*9, students were asked to simplify 10 . Many students 

learn ^rule for simplifying ten to any whole number power. The simpli- 
fied fc» of that rule is simpla^one followed by n zeroes, where n is 
the specified exponent (e.g., iW is 10 000). Seventy-three percen.t 
successfully completed Item' 9, but 12% picked 100,000 as the answer 
which is ten followed by four zeroes. Those 12% may have been very 
close to uhderstahding the symbol bift misused the rule. 



For Item 34 (see Figure 4-2), 73%^ of the'students suc^'^^^s^tully 
computed N:he Greatest Common Factor^. Another 11% seemed to misunderstand' 
the term which was being .assessed by this 
the Least Common Multiple of ^4 and 30^ 

<^ 




, but successf ullyytomputed 
ally difficult ex^cise. 
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a4. The greatest common factor of * 

24 and is: , ^ ' Percent 

" A) 2 .„^_^L ...... 9 

B) J " , . ^ ~73 



C) 120 ■ . 

0) 60 . ^ ' 3 

E) I don't know . , • 3 

No Response / . ' • 1 

, - Figyre 4-2: Grade 8 - Item 34' 



As with Itein. 34, the per^rmance on Item 7," presented in Figure 4-3 
vas iz:pressive . ^ ^ \ 

7. Which number is NOT a factor of 22? 'n ' 

V • * , rerc-ent 

— 

. ■ 78 



A) 


0 


✓ 




S) 


V 








2 


D) 


22 


E) 


i dop't know 










• / 


4 

% 



11 • 

_ 3. 
3 



•^-3 ; Gfsde 8 - i teni 7 



To be successful on Iter. 7 , ' the sxudents "either. had to correctlv 
factor 22^, or 'b^e raniliat-^ith the fact that '2'ero is not^a<rattor of 
any non-zero nunber. I ten 7 Ns also stated iii the negative fbrir., ^ne' 
of only two ^^uch items an the test/ 

^ . 3 o Knowledge of Geometric Facts ' • ^ - ' ^ • 

tour 'iteta^ were jaesigned to assress the students' knowledge of 
geametrif 'facts. me results ^f the <our items are found Table ' 
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avtt&e 8 Results (N = 42 250) i. ' ^ 

Objective : .Knowledge of Geometric Facfs (mean = 63.2%) 



Item No. 



Percent Corjrect 



Panel, judgment 



39 
40 
42 
55. 



40 

-63 

78 



Marginally Satisfactory. 
Marg'inally Satisfactory 
Satisfactory 
Satisfactory 



The Interpretation Panel' wa's generally satisfied with students* 
perforeaance on this objective. They felf the result on Item 39, see > 
Figure 4-4^ ludicated that students* knowledge of types of angles 
was''*hazy". Tventy-six percent of the. res^endents selected a rig'ht 
angle rather tKan an obtus^e angle. 







In which triangle* is angle X an 
obtuse i^ngle? 



A) 
B)' 
C) 
D) 

E) 



V 



I 

m 

IS <: 

I don't know^ 
No Response 



Percent 



12 

^ 8 

12 
1 



Figure 4-4: Grade 8 -^Itexn 39 



^.'^'Itenj 40, presented in Figure 4-5, is , very similar i?. nature to 
rten 39s was designed to requije students not 'unly to understand 
'the tern "diameter^* *but also^to select a diameter from among thcee 
radii, a d*iaineter^ and a chord. The radius which was^liot a Subset * 
of the diamjeter was selected bv *18t of the stifdents. 



'^40. If N l^the centre, which segment i$ a . 
* diameter? , /* 








Percent 


A) 


HK 


■. '5 


B) 




• ■ 18 • . 


C) 


HP / '.■ 




D) 


HM 


63 



E) I don't know ^ 8' 
No response 



Figure 4-5: Grade 8 - Item 40 



P.e^orTrerjdgtioy. 4-3 :y Classrocn teacher^ and those involved in the 
'training -of ^tather-azics^ teachers should errpkdsize the importance of 
instr-^jticn in §e(yretry* pi the elementary school mg,thematics curri- 
culur:/ and shov future te^chhers the piece geometry holds Hn both 
"^at/iematias and ever-^ddy ivfe, ' / 



4.3.6 Equivalent Forms of Rational Numbers 

_rne "final objective in the CcjsputaMorr and Knowledge domain 
required students to begin with a ratipnai number in one form and 
select the same rational number expressed in a different form. FiVe 
^itens^were designed ta measure tb^ acquisition of the objective and 
the results for .the^f ive items are present«(j in Table ^4-13. 



^ ^ ^ Table 4-13 * * 

Grade 8 Results (N = 42 250) • / • 
Obj^ective: Equ ivalen t ;Forms of Rational Numbers (la^an r ^^9%) 



— . ■ ^ 1— — — 












Item 






Percent 




; No 


Starting Form 


Final Form 


Correct 


Panel Judgn^ent 
y ti 


13 


Unit Fraction' • 


Percent 


55 


Marginally Satisfactory 


31 


Unit Fraction 


Decimal 


■ 33 


Marginally Satisfactory 


35 


Percent 


Decimal 


47 


Weakness 


46 


Proper Fract ton 


Lowest 'Terms 


80 


Very Satisfactory 


51 , 
-J 


Improper Fr4ct ion 


jjliygsd Numbera^ 


75 . 


Satisfactory \ 



ERJC 



/ 



Grade 8 students did, not appear to have any particular di^^fi- 
culty in reducing fractions to lowest terms or in changing an improper 
fraction to its mixed numeral form. . On the qther hand, sJtudents ex- 
perienced considerable difficulty in goin^ from the fraction form to 
eithfer the decimal, form (Item 31) 'or the percent form (Item 13), and 
in .gi)ing from the perca^it form to the. decimal form .(Itete 35X. After 
examining the ^perfarmance on those three items, the Panel. conclu?ied - 
that ifiore emphasis .shajuld be giv^ij to Relationships among rational 
numbers in fraction form, and percerit form. 

Both Items 13 and 31 ar,e presented ia^Figures 4-6 and 4-7, 
a comparison of the- d4stract9rs- selected may be made. 
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SO 



V 



1 . 

13. Written as a percent, -* = 

' - 5 



A) 5% 

B) . 0.5% 

C) 20°/cy|' 



D)- SOf/o 



1_1 



P^ ercent 
•19 f 
.p 
55 



JE) I don't knfckw, - ' » 

No r'^esponse . 1 ^ 

Figur^^6i Gra<Je S - Item 13 



9^ 



.r 



■\- 



ERIC 



31. Written as d decimal, = 

• 8 



X) 042 
8). 0.8^ 



D) 0 16 



. I don'l k?iow' 

No res^nse 



Percent 

38 ■, 



3- 



•Figure 4-7: :Gradg 8 - I^m 31' ■' 



.y, A.. 



8 

On Jtem 13, all of the incorrect distractors use only the digits 
5 and 0. It appears that 50% is associated with ^ closely enough not ^ 
to cause confusion. However, 5% and 0.5% were each ,selec,ted by 19% of 
the students. One could hypothesize that the selection '.was made because 
5 is the denominator of 1/5. From the data one cannot t^ll 'how-ihany 
o students selected. 20% sijfiply because it used different digits than''all^ . 
the' other di'Stractors . , 

Adding the information from the results of Item 31 to the results 
of^Item 13 strengthens the impression that students ^o selected an 
incorrect answer diH so becaus-e the distractor used the same digit as 
the. denominator of the ^fraction. The denominator , -of the fraction .in ^ 
'.'"Item 31 is 8 and disttactor B'is-Q.8. It is' the one di6trac\or that, 
uses pnly the digits 0 and/S, and it was chosen by ^1% pf the students. 

. ^ ' Though ^he/ fesults .may be due,, in'part, ^to fhe format of the 
distractors, the Pan^L was very disappo^nteti / in the perf <>5rmance (47%) *• 
of the^ scuderits on Iteft 35. / - e 

.... 

^ c; equivalent forms b/] r<^ional mmbers* Students ne^a many exp'eriences 
of ^ starting with a, rational number^in fraction form^ decimal 'fdrm^ or 
'zercen,t fc^rin j2'nd'Wnting it/ in -the oth^x^ two foi^s. 



4 . 4 Vest ■^^^ul'^ST Comprehension .Domain ; * 



.V. 



The Ccmprehens-ipTi Domain consisted of eighteen items measuring the^ ^ 
acquisition of four, objectives. The results for the i^tems in the Compi!^e- ^ 
hension Domain are ^presented in this section organized by objective. 



G^mjy^henViQn of Number ^Concepts ' ^ 



Six items were des<tgned .^to assess the students* comprehension 
of number^ concepts . The results for the six items ^are presented in 
TablX 4-14, ^ ' 

. > ] V ' Table 4-l4# - ^ ^ 

; > -Graded. Results (N ;= 42 250) 
" ' Obj^cti^e: Comprehension of\;^umber Concepts- (mean - 53.5%) 



— 4L 



H^m No . • • Percent Correct vPanel Judgment 



H) , _ . • .90 St<rength 

l-2'^" -T ■ - . V 42 ' Marginally -Satisfactory 



^ _ 69 ^ ' ,.Satisf actory 

/'18 ^ 32^ . • « {^i^^akness^ 

*47 ' , . ' 29 ' Weakness ^ 

50 " *f '59 Sati'sfactory 
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Item 1*2,^ see Figure 4-8, .required the studenfes to' simpfify 0/6 . 
Students |it;^all levels ytend ^to haVe difficulty with ..proper ti^ of zero. 
The Interpretation P^nel felt that the resu3tts on this itei^ indicate 
that propferties of zero have not been mastered by Grade 8 students. 
While the Panel judged the results df Item 12 as marginally satisfac- 
'tory,-' it' is not surprising that the^ students were evenly split between 
the correct answer and distractor D, since 0/6 i,s 0 and 6/0 cannot be 
simplified, It^is rather surprising, however, that 14% of t^ie students 
ecxed distractor, C, . > - 



^ * • Jr.... ± 

6 ■ : ^ / 



' ''-^Ta'^-^ ^ ^ 7v ^ Percent* 



. c) ^57 ^ . a4 



'1 



0) eannbt be done* 3^ 

E) Idon'tkn^W "5 / 

0 . \ 



.Figuri? 4-8: Gjade '8 - Item 12^-'' ^ 



. - The 'Panel' also stated that J:ner^^eems to be an evident strength 
in the understanding 'of place valu"^ when* d'fealing with whole numbers, 
but vt;he stjrengChis npD a^ Wident when dealing with, rational numbers* 
in decimal ^ornf. ' Tl^y expres*se'd opinion that ^ra'^ions^ shoulci fcw^ . 
"presented in many equivalenoX^f c>nnB wh^ they af-e 'tadght • ^ ' " S *^ 
/ ' • . ' ' ' / ' - ^ ' * ' - ^ • ' ' 

, Iteih IG^ pres^nte'd ifn Tigure 4-9, was judged to .be a weakness^ \ 
aiaoa^ Gracfe 8 *statfejits, 'VTHile jfhe answer 'i% a 'fraction, it ta)ce& two 
• steps to crfeate ^he ftactioni Of the stu4e.nts tested, 53% cojrrectJLjy ■ 
took the iiunrfier o'f boys, as^ the .numeratar, /but took the 'ather numbed in 
the problem as the denomi^nator . pDO tDf^ten,'all 'that, students do with^" 
*ja pr6b,lem is' take* Uje' numbers as they appear, combing them bX^. a one-step 
proi-ess, ^^nd obtain an answer which is ' f requer(t4.y the.'incorrecf oij^. 



18. There are 1 3 boys and f 5 girls in a 
' group. What fraction of the group is^ 
boys? ' ^ 

Percent ;^ 
5 



53 
6 

■3i 

» ' 

'2 

■ i 




E) I don't know 

No response 



\ 




Figure 4-9: Grade 8 - Item 18 



Item*47, see Figure 4-10, was also judged as^ weakness. From 
the data collected, - what' actually caused 38% of the Grade 8 students 
• -to select 2/3 as the answer cannot hje determined. | Several conjectures 
howev'er,. can made^: two-thirds is the- laost commonly used fraction 
of the 'secj^^^f rac«>ns presented, the students' concernec} themselves , 
at^rictfy with. 'the. rfflative. magnitude of th^ denominator, the students* 
ccmXci ortly "apply th^ process of pair-wise comparisions of ' fractions, ' 
; t1:i^stu^ents were not familiar with the proce,ss^for computing decimal 
^^qui'valents^ for the* f rac't;ions or the impqr'tance of doing so. the weak 
PQrfdrmaace on t'his item underscores the/importance of recommendations 
4-2 an^l 4-4. ^ . ' . < - - / . V . 



47; , Which number is largest? 

. ^ . Percent . 



A) 

3 

i ' 



3-8 



29. 



E) : I don't know 
No response 



1 



16 \ 

12 

2' ' 
' 1 , 



A 



\ . Fi-^ure,.-f-10: Gr.adp 8 - Item A7' 
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TTOT" Compr efien t Cone ep t s 

Five items were used to measure acquisition of this objectiye. 
The results for the five items are presented in Table 4-15. . 

/ ' \ ' ' 

\ 1 " • . Jable * ' . ^! 

Grade 8 Refults (N « 42 250) 
Objective: Comprehension -of Measurement Concepts (mean = 69,4%) 





Item No. 


Measurement 

— 


__Unit ^ % 


vCorrect . 


Panel Judgment 


22 ^ ^ 

23 
43 


A^mperatujre 
Capacity ' 
^ Weight* 
J.ength 
^Angle 


* Degree Celcius 
•Litre 

Kilogram 

Centimetre 

Degree 


69* 
84 

84 
65 


Satisfactory • 
Strength 

Satisf actory^ . » 
Very Satisfactory 
Satisfactory 



Four of the fiv^ items for this objective measured students' 
ability to select t;he appropriate' metric measure. The fif th ^^tem, » . 
Item 43, (dealt with measurement of angles.* , - - 

# * ' " - 

• The Panel found th^t the '-students were having little dif£icul|^^ 
with the skills tested by^^hg^ specif ie *item^. ^ Tha^Pan^l wondered* ifv 



7 



the metric concepts were, being well-taught or if 'tlie generally gipod.jJh 
results were the result of ^out-of-schoo^ exp9sure to the material* 
* ' ' *. ' / ' ^ 

Item 22. yielded thB loweaiuperfonnance* level* fpr' this obj^tive. 
-■Jhe Panel hypothesized that tshef^ low performance may have, occurred be- 
cause 'weight (mass) in metric ^nits is not widely used in society at 
present.^ Lack of exposure may have caused^ the low performance. 



/ 



22.' A ten-year-old b 



A) 
B) 

'C) 



35 grams- ^ 
^5 grarps 
35 kilograms 



is Hkely to weigh:? 

PeT:cent 
•10 • 

13 
45 



75 kilograms 

I don't know 
No, respqns'e 




Figure* 4-1 Lr.^r^de 8 
gh technically d'n<?orrect 



19 
12 

' ' 1 
Item 22 



the 



word *weigh',*nOt *ma^§', was used 
on the test. It was deemed more advisable to run the r^sk of being 
criticized^ for' using the familiar ward 'weigh' than to pse the decidedly^ 
unfamiliar, y^t correct, term /mass'. , ■ 
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On the otl)er l^nd, Item 19 <see Figune 4-12) is an item on 
Aemperature, using degree Celsius as^ the unit. The degree Celsius 
was one of the first metric units to be ihtroduced in Canada, but 
the result of .this item is not^erji high\ ' 



19. The temperature on a sunny summer 



4 



day>0Mkl most likely l>e: 

5' Celsius 
Bj 25" Celsius 



Percent 
5 . ' 
69 



C) 551 Celsius i, 

D) 85" C?l$ius 

E) I don't know 

No- response 




12 
9 



iguje 4-12: Grade- 8 - Jtem 19 



.8 



The students^ performance on mej^ri^Uength (It;em 23) and metric 
capfec4ty (Item 21) was very) good, both 84%./ The Panel did say, howeve 
that as C^ada g>^es metric these performance levels, on the metric 
measurement items far' this assessment may'riot be viewed so favourably 
on future assessments. , / ^ 



^•3 Comprehension of Geometric Concepts 



The stua'^^nts' ability on this objective .was measured by four 
items^. . The results, for the four items are presented in Table 4'-16. 




Table A-16. . ■■ < , 

.Gxade -8 Results (N = A2 25p/ ' ; ■ / 
\ P^j^'^'^^^^- 'CofflprHi-ension -of Geometrlfc Concepts (mean = 53.8%), 















Percent 


»- 

?:6irrect 


r-s : ^ 

^ ' Panel Judgment 


.^3-8^ 

. 4i °" 
52 

* 


69^ 

24 
63 




Satisfactory . * ' ^ 
Marginally Satisfactory / • 
Weakness 
Satisfactory 









• 


v<:.'-- ■ • 
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The studfents' performance on Item 52. was tlie secVnd lowest on 
the entire test. Forty-two perce.nt^of them simply multipl^ied the 
height of the triangle by the base and neglected to multiply* that 
product by 1/2 • Such an error is common when working with triangles. 
More surprising however is that 18%; of the students selected digtrac- 
tor,B, In other words,' they. added the height and bas^ of the triangle, 
Oii Item 54, finding the volume of a box, 13% of the students added the 
dimensions instead of multiplying them, ' ^ 



Find the area of ^his right triangle. 










Jt^-cent 

A 




'A) 


42 > 


Ik' 




B) 


20 


18 




C) 


84 






D) 


21 


4 


9 


E) 


1 don't know H 



No response 1 



/ 



Figure 4-13: Grade 8 - Item 52 



As the- Panel stated in its summary comments, Geometry is con- 
sidered important in everyday life, ^Perhaps the emphasis on basic 
aritljmetic has coi>tributed to the deterioration in the comprehension 
o'f geometric concepts. The difference between the mean pefcent correct 
for Computation with •Whole' Numbers and Compirehension of Geometric Con- 
cepts is exactly 30% (^3,8% -vs- 53,8%), The Grade 8 .studerit popula- 
tion in Br itish'Columbia appears to be fairly well drilled ii 
tion with whole numbers but not so adept at comprehension oi 
concepts. 




computa- 
pmetric 



The Panel also wondered if teachers ai;e postponing the teaching 
of geometry so that it gets done only if there is sufficient -time in . 
the year. ^ . . " . . " L * 

^The Grade 8 students' performance on this objective was dis- 
appointing 'and the Panel's summary comment was t^iat an overall weakness 
is evidpnt. They felt that if geometry is. to be considered important, 
then perhaps the approach, and placement in the curriculum should be 
examined. Fur thermo^, they expressed the opinion that pLxle€*ical uses 
of geometry should be emphasized, ^ ^ 



\^ornrn^ndation No.. 4-5 : Teachers should plg^ greater emphasis upon- 
the topics of geometitnj and measurement tti tneir mathematics classe^mk 



a t 
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4,4*4 Comprehension of Algebraic "Concepts 



X The GradiB 8 test contained three ifce^s desflgned to assess 
students' ability on this objective and two of these were repeated ' ' 
on the Grade 12 test* The Ranel's comment that there wjere not suf- 
^ ficient items to adequately test this objective is^well taken, 
Howevegr, no attempt was made to assess this objective in depth at 
any of the grade le"<reis, and certainly not at Grade 4 and 8, ' The 
results of the three' items are summarized in Table 4~17, . ^ 

{y- \ ' { 

Table 4-17 
Grade'^ Results (N = 42 250) 



Objectiv€: Comprehension of Algebraic Concepts (mean = 52.7%) 



/ 





Item No. 




Percent Correct 


PapTel JuiTgment 


48 




— ^ — ^ 


^Weakness 


56 




72 • 


Satisfactory 


57 




68 


Satisfactory ^ 


. » 


V 




^ 



r 



The Panel felt , the results were gfefierally pleasing in this^area 
for the Grade 8 level* Almost all of the Panel's comments dealt with • 
the^xtremely low perfo rmance } the lowest on the^test, 'on Item 48 • ^ j 
Not^ surprisingly, Item 48 ic also the item tb^t yielded the second 

^t 

s^nds to (30(-4) (8-2), 
was seledted by 36% of the students teated and 20, #hich* corresponds 
to (30~^)|-(8-2) , was selected by 25% of the students. Both distractors" 
:ted more often than the correct one". 



/ r-,- o-y > 7^ J -s--^ — ~ 

highest percent on the test (16%)' of students Selecy.ng. the "I 
know" di'^bractor. The response of 156 which cortesppqds to (30|-^ 
lec' 

t 



were seJ 



0 




ERIC 



\ 



,48. Simplify: 30-4(8-2),=^ 



A) 
B) 
C) 
D) 

E) 



0 

20 
156 
6 



\ ■ 

Percent 

* 

2 ^ 

'25 * 
• 36 
* 18 ■ 



I don't know 
No response^ 

Figure 4-14: Grade 8 - Item 48 



.9.3 . 



16 
1 



\ 



The Panel corfcluded from the results of Item A8 that the order 
of operations concept is not being learned and more emphasis should 
be placed 'upon it in Grade 7. More Importantly, however, the Panel 
felt that an evaluation should be made concerning* the importance of • 
the order of o^eradons concept and whether or not it should be in 
the curriculum at this level, * * 

^ It should be noted that the order of operations concept was not 
only important enough to be placed in the proposed Core Curriculum by 
the Ministry of Education, but also the necessity of including an 
order of operation item .from the a&sessment test was mentioned by all 
four. Review Panels, It was .in response to such suggestions that Item 
•48 was included 'on the test. 

The Panerwas satisfied with the performance on the other two 
items for this objective. Item 56 (evaluating an algebraic expression) 
and Item 57 (solving an equation) , 

Reaormendatipn ^6 : If the order of operatvon concept ^s to rerrmn a 
part of th^currioulum of the elementary grades^ then teachers^ must 
place more emphasis upon it. ' 

4.5 Test Results: Applications Domain > ^ 

For Grade 8, the Applications Domain had on^^^^^<3j^^ectives, acquis- 
ition -of which was measured by^ ten litems. The f^/^xiss^j^ pf ^e results for 
the Applications Domain is presented in this se.c^ion o^gani^zeii^by objective. 
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A. 5,1. Solve Problems Involving Operatio;ir^ith Dif-ferent Sets of Numbers 

Seven items were designed to ass^s students ability to solve 
piroblems involving operations with whole numbers, fractions, decimals, 
and percent. The results for those seven ite^s are presented in Table 
A-18, 

. ' Table Ar-18 
Grada 8 Results (N = A2 250) 
Objective: Solving Problems Involving Operations 
'With Different Sets of Numbers (mean = 62, 



i 



ERIC 



Item No, 




Percent Correct 


Panel Judgment 


. 24 




91 


Strength ' 






60 / , 


Satisfactory 


^6 




63 / 


Satisfactory 


27 




63 V ) 


Satisfactory' 


■ 58 




66 


Satisfactory 


59 




57 


Satisfactory 


• ,60 




38 


^farginally Satisfactory 






: * 

94 





JL 
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ri^>/^ . ^ The students'. Derformance on each of Items 25, 26, 27, 58, 
■ J»-.*59'"was judged ^ta\tfe^ ^Jfctisfactory , The Panel felt that perhaps the 
'^ncept of airi'^hmetic average, and the topic'of cirple graphs, ' 
should bVg4^i^ ^dditiorial emphasis by teachers in Grades 7 and 8., 

Item^ 58^ai£^}^", 6.0 were all based on the same circlB graph, 
but only Irtem 6j0 is ^fcjyten bejow, ^ 



r 




Tf»e^1200x$iuclents \p a secondary school were„ asked to name their* 
favourite Olympic sport. The results are shown in th^ circle graph above. 



60. How ^mdny more stucfents chose figure skating than gymnastics? ^ 



c 



A) 420 studenj|§ 

B) 35 students 

C) ^ 60 students 



Figifre 4^-15: Grade 8 - Item 60 



D) 6 stj^^ents 

E) I don't know 

No response 
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19 

38' 



24 

10 
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As the Panel stateii,- the result on Item 60 was 'somewhat dis- 
ppointing considering die diffetent metho^s^ of _ solution available to 
students.^ Nineteen perce^it of the students simply added the percentages 
given and used the sum as the number of students. Twdnty-four percent 
of them subtracted the percentages and. used the difference as the number 
of students. ^ 



" Item 24 is an excellent- Example xff. how well Grade students can 
perform. a one-step problem. For Item i/, the .student 'multiplies the ' 
only two numbers pro^^ided ^nd has ^ the Answer. The , 912> performance^ 
level certainly represents a strength 




er|o 



».^» a .> a . , ,»,«^ / f» - iii..i.i..> > .. r i.i... * 4.>«^ 



Z7 



Percent 



y 



24. There are 25 members in tti^ volleyball 
club. If the cost for e^ach uniform is $24, 
how much would it cost to buy new 
uniforms for all the club members? ' 



A) 


$ 49 


2 


B) 


$66oq 


- 3 


C) 


$ 60QL 


91 


D) 




2 


E) 


1 don't know 






No response 


1 



/ 



Figure 4-16: Grade 8 - Item 24 




Recormendation 4-7 : Teacher^ of mathematics at all levels must 
emphasize problem* solving. Problem solving cannot be justsone 
unit among many; it should be given high priority as being central 
to all aspects of mathematics , Students must have many experiences 
of solving multi-step problems and they should be taught to verify 
the reasonableness of ^heir answers to problems. ^ ' * 

4.5.2 Solve> Problems Involving Geometry and Measurement 



Thfee items were tffesignecl to asse&s the Grade 8 ,studen 
ability to solve problems involving geometry and measureme 
result^Vfor the three items are presented in Table 4-19. 



^ f 



Table 4-19 ^ 
Grade 8 Results (N = 42 250) 
Objective: Solving ^Problems^ Involving Geometry and Mea 
^ ' (mean = 51%) 
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Item No. 


— — 


Percent Corrects 

- . 


5 = 

Tanel Judgment ^ 


3.6 
• . 37 . 
'53 

* 




■ ■ '66 
27 
60 


Very Satisfactory 
-Weakness 

Margina^rly Satisfactory 


♦ * 


< 




♦ "I 



"students on Iteir. -37, see Figure 4-17, i? very disappofnt;ing-. ' The Panel 
felt the low performance indicated the students lack an 'understancy.ng' 

.of the conc^pt^f ^rea. \i/hile the figure accompanying Item 37 was drawn J' ^ 
to be as clear ate .possible, tt may/have still confused the students. \ 

. pdwever, the fact more students selected the *area. of the' unshaded portion^, 
(-96) as the answer than the correct ansv^r" would lend^ support^^v to t^h(& be- \J 
lie^ that it was*" no t the .figure that caused the low, pferfonnanc^. ^ "I dop't 
knqw" was selected by .jnore^ students (21%) o% Itemjj7 than, any other item 
on the test. * ^* ^ ' ' ' * , * ^ 
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12 
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37. Whit the area of the shaded portion 
of this figure? 



54 



A) 

B) 96 

C) 120 

D) 60 



EJ I don't know 

^ . No response 

Figure 4-17: Grad^ 8 - Item 37 



■ercent 
27 



28 
• 11 
.'11 

•21 
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The Panel was very satisfied with results for* Item 36, especially 
because of the reading' involved and the possible confusipn introduced by 
using metric Units, Though it is agreed that the performance level was * 
very satisfactory, 11% of the respondents marked "I don't know" and 12% 
of the respotidents marked 625 as the answer* Students selecting 625 as 
the answer combined the numbers provided with the wrong.u)peration, mul- 
tiplication instead of division. 



serves 



,Thp following quote from the ^Panel's report on the Grade 8 test 
as a good summary, for this objective: * 

. ; ^ ^ 

"In summary, it was f^lt that the questions and answers 
(distractors) were generally* well constructed^ |nd that the 
students' responses were satisfactory, given the apparent 
low priority accorded problem solving. Problem solving, 
nqt merely 'word problems', and applications should be seen 
as a major focus or core of the Graded 4 through 8 curricula*. 
Various models/or strategies for profilem solving should be 
emphasized strongly by teachfei; training institutions, and ^ * 
througli in-servigfe programs. This ar^a of mathematics sTiould 
be conveyed to teachers and students alike as being 'centra.1 
to all of mathematics, " 



4.6 Grade *8 Reporting Categories ' ''r 

Mathematics achievement is the end result of the coal^^cing of a great 
• number of student-based factors, -both intrinsic and extrlhsic. Attributes-^ 
inherent in the student, programatic and curricular .varf^les*, ^s well as 
the effect of environmental variables such as teacher <2flf f erences all con- 
-^tribute in varying and^ largely unknown degree to a^gi^en student's overall 
^performance. Of the fairly, large number of such variables which the con- 
ventional wisdom, current educational practice, and the endeavours of edu- 
catiouar researchers have ±<fentif led *as being related .to mathematics • 
achievement, a limited number were selected for scrutiny in the Mathematics 
Assessment (see Chapter 1, Section 1.4). 



A great ddal more information concerning the relationship between 
certain personal background variables and achievement on the Mathematics 
Assessment test was collected than could poss'ibly be reported in this 
voltime. A more complete rendering may be found in the Technical/ Repojit * 
dealin^with test results which^^s obtainable from the^Learning Assess-* 
ment Branch. Researchers or otfiers who wi^h. to have access tjo the original 
dat^ in order to s4ek answers to their own questions on issuer relevant 
to the Mathematics Assessment should also dir'ect their requests to th^ iv 
Liearnlng ^Assessment Branth. ^- » ' 

. t In the sections tha't follow, all of the results reported and recom- 
mendations, ma d4 are based upon correlational trends. No atteunpt is made 
to imply that : cause and effect relationships exist since t1^ Mathematics 
Assessment was not designed to- identify such relationships. 

. It ^remains for studies designed as follow-ups to the present one to 
seek to^ identify such relationships. Thus> while the assessnaent results' 
show several fairly strong relationships between a student's sex, and that 
student's achievement in maftjjematics , this does not imply that achieve-^ 
ment in mathematins is determined by a student's sex. All that can be said 
on the bdsis of the assessment data is that there appears- to be a relation- 
ship between the two variables. 

For each of the rep6rting categories discussed i,n , succeeding sections, 
reference is. m^ide to the various domains, objectives, and items evaluated 
in the Mathematics Assessment. For ease of reference, a labelling 'systeip 
for domains and objectives has been adopted and will be used throughout 
th^ remainder of this chapter. Each objective has been assigned a code 
number consisting 'of two digits separated by a period. For-r exapple. 
Objective 2.3- refers to Domain 2 (Comprehension), Ob jec*4ve^ 3 Comprehen- 
sion of Geometric Concepts) . In Table 4-20, which follows,"th:e rightmost 
column indicates the. section of Chapter* 4 Where the Grade 8 populatioti ' 
results for the appropriate objective? were ini^tiall^4,iscussed . 

' " Table 4-20 , ' * 
Grade *&: Code Numbets Used p&i Objectives 









Report Section for 


Code Number 


' Oft^ective 

. k 2 


Populafion Results 


1.1 • 


' Computation with Wh9le Numbers 


4.3.1 




Computation with Fractions 


4.3.2 


1.3 


Computation with Decimals 


4.3.3 


•1.4 ■ 


Notation and Terminology 


4.3.4 


1.5 


Knowledge of Geometric Facta • - 


^ 4.3.3 


• 1.6 


Equivalent Forms of Rational Numbers 
bjumber Concept^ ' ^'^^ 


4.3.6 


2.1 


4^4" 1 


2.2 


Jleasuremept Concepts ^ 


4.4.2 


2.3 


Geometi/ic Concepts v 


4.4.3 


2.4 


Algebraic Concepts 


4.4.4 


3.1 


Arithmetic Problems 


4.5.1 


3.2 


: peometry and* Measurement Problems 


4.5.2 
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^ 4,6;i Age, . ' ^ ' . ' V 

The graph displayed In^ Figure 4-18 presents a cbmiJarison. of 
^sflideht performance on each Objective for each of four age grcuj^irxga^/ 
15 ye'ars X)r older, 14 year olds, l3 year olds, ,12 years or younger,' 
On eleven of the twelve objectives, performance increases witli a 
decrease in age up to the 13 year old. The L2 years and younger ^ ^ 
group's performance is less than or equal to the 13 'year -olds ' per-, 
fqrmance. on eleven objectiyes and about^ two pefceht greater on ob- 
jective 3v2; The 15 years or olde?: group's perf ormajice- was an average 
of about eighteen percent* below the provincial mean* While the per- 
formance of the 13 year old and 14 year old groups, representing « 
over ninety percent of the population, have a much gVeater^.'i^mpact 
upon the' provincial mean than tho^e of the other -gfoups^v the relative 
'^positioi^ of each group is clearly implied^'by the data, /' 
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4. '6. 2 . Sex Differences 
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Both NLSMA and NAEI* reported that girls .outperf^rmjed boys" only 
in those areas of mathematicsi. feiich as computational skills wh;ich 
involve l^wer level- cognitive^ behaviours. Based on such results one 
would expect the gijrls to outperfoipn the boys in Domainal, Computation 
and Knowledge, and the boys '%o' outperform the girls on the other two* 
domains* The data presented Figure 4-19 supports the NLSMA and, 
NAEP results quite- clearly^ althpugh. siany ^of .the differences are 
rather small in §ize. . • ' / , ^ ' ♦ 

• Each group performed bettejf than the other on six objectives, 
but of the six objectives on which the girls scored higher, > five .ai^e 
in Domain 1,* the lowest' cognitive behaviour level. 
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Figure 4-19: Grade 8 Results by^Sex 
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^•6.3 Number of Schools -Attended 



The pattern of performance organized by the nutdber of schools 
the students havely attended is an extremely consistent one as shown 
in Figure 4-20. The performance 'among those who have attended eight 
or more schools, is always lowest, the next lowest performance' is by 
either the one-schoal group or the seven-schools group. The highest 
performance is achieved by the two-school group on every objective. 
The two-school group's performance/is followed in order by the per- 
formances of the three-school group, then 'the four-school group, thep 
the five-school group, and then the six-school group. 



The performance always increases from the on'e-school group to 
the two-school group. From the two-school group to the six-school 
group, there is a consist;ent but slight decrease. The decrease in 
performance is then more pronounced for ^the seven-school group 
'the eight-or-more group/ 
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Figifre 4-20: Grade 8 Results 
by Number of Schools Attended 
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'A. 6. 4 Use of Hand-Held Calculators • ' / 

Students were a^sked .whether or not they used h^nd-hei4 calcu- 
lators at home, at school, or for homeVork. Figureq 4-21 thtough 
4-23 chart the assessment results for these three , aspects of i calcu- 
lator use, ' • . ■ 
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• > Figure 4-21:* Grade 8 Re§ul.ts |^ 

by vniether or Not a Studenjt Uses a Hand-fleld Calculator 
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Those ^students who,_ used a hand-held calculator at home outperformed 
the students who did not use -a hand-held calculator ^t home on eleven 
of the twelve objectives. ^The non-users o^- calculators at hgpie performed 
Jiigher on' Objectiv/e^ 1. 1 , Comp^utation with Whole ifumb^rs. 

■■ . ^ • . ■ ■ ' • , ■ r ■• " 
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figure '4-22: Grade 8 'Results, 
by Use-M Hand-Helld Calculators for Homework' 




Students whp used a hand-held calculator to do thdir homework 
outperforiped non-users on eight "of the'twelve objectives/ the two 
groups tied ont Objective 3.1, and non7Users outperformed theWhers 
on three objectives. , Interestingly, . the objectives" on Which the ' . 
.students who did not use a hand-held calculator for their -homdwork " 
JMloifea higher were all compuia'tipnal objectives — f.l. Computation 
with Whole Numbers; 1 . 2^: Computation wfth Rational Numbers in Frac- 
tion Form; and 1 .3,, Computation with Rational Numbers in Decimal 
Form. . . . 

For the category' concerning whether or not the .students used 
a hand^held calculator at school, the patt^ is reversed and very ' 
\ consistent. Tljevstudenfes who did not use a hand-held calculator at 
school outperformed the students who did on every objective. • 
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4»6/5 Time Spent on Assignments 



^' ^ The question concerning the amount of time spent on mathematics 
assignments outside of regular class was directed only to thosfe students 

^who had. responded that they were taking a mathematiK:s course at the" 
time of ^ the Mathematics Assessment, Of the 42 250 students who wrote 
the test 2 866, or ^bout seven percent, responded' that they were not 
taking a mathematics course. The breakdown of th^ data based on the 
amouiit o,f time spent On mathematics assignments outside of the regular 

.class*, i.e., homework, can be found itn' Table 4-7 of Section 4^2.7 of" "\ 
this chapter. i . • ' ' 
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The performance patterns are very distinct, when the data are 
presented graphically, as in Figure A-24. The *gtoup that did* spend 
some time, but iess than thirty minutes a day, on math^atilcs home- 
work^ outperformed the thre^ other groups .on every objective. ' - 



The belief that one 
not appear to be supported 
more than sixty minutes a A 
on every objective. On the 
dents simply take longer to 
the performance of the thir 
paralleled the top group's 
more^ closely paralleled the 
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cannot spend too much tinie' on homework does ^ 
by these results, since the group spending . 
ay scored lower' than the other three groups 

other hand, it may be that. the poorer stu-. 

complete the assignments. .In any even£, 
ty.to sixty minutes a day group more closely 
performance, and the '''none at all*' group* 
.bottom group**s performance. / 
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Figure 4-24: Grade 8 Results by Time Spent on Assignmei;its ' 
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4.7 Reporting Categories jrom 'Reading Assessment ' 
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^ In-addition t?) the Mathematics test, ^n assessment in R-tading was a] 
given at the Grade 8 level. Thesis two tests contained simillr, and in sc 
cases i'de^tical, background 'information questions.. On toth the MathematJ 
agd Reading tests, stucents were asked -their -birth date, sex, \ and number 
schools attended. Using 4:he common information, a computer search was at 
to match the complete ■ reading and mathematics data for-sixty-sW percent 
the students. A data file was cfreated to contain the information and results 
on both tests for these matched students so that comparisons bditweeti the: 
performances on the two tests could be made. 
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The new data file v/as used to obtain furfher information on\ student 
performance and to correlate certain aspects of student perf r)rniartce im ^ 
mathematics With student performance in reading. In Sectiofi 4.6 bf this 
report the data of the-I atheiqatics Assessment for' Grade '8 were organized . 
according to certain reporting categories such as age', sex, and u^e of hand- 
held calculators. In thi§ section the Mathematics' Assessment , data. for Grade 
C ate organized by fwc reporting categories obtained from the Reading Assess- 
ment. 



^ * Domain Two of the Roading Assessment wa*s Comprehension as it wa^ in the 
Mathematics Assessment. Correlations wer.e computed on the Grada 8 M^themanics 
Assessment results for^^he four objectives- of the Comprehension Domain and the 

^two objectives of the: Application .Domain with the Reading Assessment Results 
for the two pbjectives of .their Comprehension Domain. * \ 

V , 

4.7.1 Reading Repor t jLng^ Categories ' ' 

The' two reporcing categ^pries from the Grade 8 Rcjading Assessment ' 

which are preseutcd in thi,s -section corfc^rn language groups and television 

vj^tching.' The three items shown in Figure 4-25 appeared on the Grade 8 - 
Reading test. » ' ' ^ • , > \ 



1 . . Mhre you born in Canada? 
Yes . . 

0'° 



r \ 



2. Did you usually speak a language other than 



English, before you started Grade 1? 



Yes 
No 



3.. Is English the language usually spoken in. 
• your^homeZ. * ^ 

Yes . . . . . . 



No 



□ 



r 



□ 

1 ' 
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Figure' 4-25: Place of Birth and Language 
Items. from the Grade 8 Reading Assessment Test 
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The results for the three i terns >^were used » to organize the, Grade 8 

students into five groups. The groups vere defined as follows: 
\ ' * 

1. Non-Canadian,* Non-English — All Grade 8 students who responded' 
' "No'' to Item l,''"Yes" to Item, 2, and "No" to ^ein 3 in Figure 

2; Canadian, -Non-English — All Grade -8 students who responded "Yes", 
to Item 1, ''Yes'- to Item 2,, and "No"' to Item 3 in Figure 4-25. . 

: ^ * 3 

3. ' First Generation Canadians — All Grade 8, students'^who responded. 

"Yes^* to Item 1, "No" to Item 2, and "No" to Item 3 iri Figure 
4-25. > 

i* . ) - . ' 

4. Nofe^anadian, English — Ap-l Grade 8 students who responded "No" nL. 

tQ Item 1, "No'- to Item 2, and "Yes" to Item 3 in Figure 4-?5. ' 

5., Canadian, English — All Gr^de 8 students who responded '^Yes" 
to Item "No''" to Item 2, '^nd "Yes" to Item 3 ^in Figure 4-25. 



Once the data werie organized into the fiye groups, the results 
on each of the three' domains for the Grade 8 Mathematics Assessment 
were computed. The five group averages for each^^dpmain are presented. 



in Figure 4-26 
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Figure 4-26: J5rade 8 Results by Language Group 
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The Non-Canadian, non^English gr^p of Grade 8 students obtained 
the highest si^re^on all three -domains. The first generation* Canadian 
group' scored lowest onfall three domains. The middle three groups' , 
average rankings were close together, diff.ering by less than one p6rten- 
tage p^int. These results indicate that students who have a non-Er.gliph 
speaking background perform well in ma^ematics and are certainly not 
disadvantaged in this respect. ^ V * 



Recoimendation 4-8: Researchers shoKld investigai!e the ^Precise mtUre 
of the relattonship heU)een language background and ,achievertient in ' ^ 
mathemattcs. : ' . . « , ' 



The 'item shown in Figure* 4-2^ also appeared oq, the Grade ^ Reading 
Assessment test.s ' . ' . ^ * & 



About how many^hours o^ television, 
watch* on .an 'average day during the^ 


dp you 
week? 




Usually none . . 




.□ 




'Less than'l hour 








> 

About 1 hour • 
About 2 hours 




□ 
Q- 


^ 


About 3 hours 






* V 


About ,4 hours . . 


t • • • 


■ □ 




5 hours or more . / 




1 





Figure Television JWatching Item 

from the Grade ^8 Reading Assessment 



The. Grade 8 r,esults from the, Mathematics .Asse'^^ut were organized 
into seven groups based on the sev^n choirs shown in the item in Figure 
4-27. The results ^^re presented \vi Figutre 4-28. , . ^ 

*The Grade 8 students who watched less* than one' hourr of television 
per dax during the week- had the best performance ^followed clos/Bly by 
the about-one^hour group. The pattern among all of the. groups is ^ 
that the more television that is watched', the lower tjie performance 
on the Mathematics Assessment. The non-ttlevision group's performance 
W9S about uridway between the aJ>j^ut*^three-hou]rs and the about-f our-hours 
groups. . s • ' • ' • 

■ The pattern exhibited in the^ GrSide ^ results* is very different 
frbm the pattern that existea^"~iTi the Grade/Year 4 data, as presented 
in Section- 3.6 of this report. , , . . ^ 
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Figure 4-28:^ Grade 8 Results by Television Watching 



4.7.2 Correlation 



leading -Results with Mathema*tics Results 



Domain Two of "the Reading AsTsessment was entitled" Comprehension 
as was Domain Two of the Mathematics Assessments Both tests^ attempted 
to assess comprehension of /iheir respective content areas. To see if 

' there was a relationship bistween scores* in reading and scbres in mathe- 
matics, correlations were computed between the four objectives of Domain* 

^ Two of the Mathematics Assessment anci the two objectives oi Domain Two 
^of the Reading Assessment. . 

Since all the items-, ' except one, of the Applications Domain of 
the Mathematics Assessment requir^,d a great deal of reading compared to 
,^ the other ^test items, correlations Jjetweeii the two objectives of Domain 
Thre^^f the Mathematics Assessment and the two* objectives of Domain, Two 
of the^ead^ng Assessment were also computed. AH, twelve correlations 
are presented j.n Table 4-21. 
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• Table 4-21 

Grade 8: Correlations of Reading and Matheinatlcs Results 
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• Reading 








Mathematic 


f 

s Objec^tives 




Objectives 




2.1 


° 2.2 


2.3 


2.4 


3.1 


3.2 


*♦ * 

. 2.1 




0.36 


0.33 


0.33 


0.32 


0.43 • 


0.39 


2.2 

4 




0.39 
V 


^0.33 


" 0.33 


0.31 


0.43 


0.39 



















The test to determine if a correlation ^is significantly different 
from zero is dependent upon the size of the sample. Given a sample of 
size 27 847, a correlation of 0,02 or greater would be statistically 
significantly different from zero. Hence it is more appropriate to 
talk of educational signif i-cance. Glass and Stanley present the fallow- 
" ing categorization of correlations: if the correlation is less than or 
equal to 0,2.then it should be consi&^red weak; if the correlation is 
between 0.2 and' 0.6, then it should be considered of moderate strength; 
if' the correlation is greater than or equal to "0.8, th^en 'it should be 
'considered, strong • ^ * • 

All of the correlations in Table 4-21 are of* moderate strength^ 
J .Within a domain the correlations are very 'consistent and between the 

two objectives of the Reading Assessment the correlations -are very con-' 
sistent. The correlations for the four objectives\)f* D\)main Two of the 
Mathematics As^sessment differ by only 0,08 and half of the correlations 
are 0.33, Of the correlations for each mathematics objective with the 
two/torresponding reading objectives, four are identical • The correla- 
tions for Domain Three average about 0.07 greater thaw^ the correlations 
for Domain Two. . ? 

• . / . 

4.8 Summary and Recommendations - ' ^ ^ 

The Grade 8 test consisted of sixty items measuring acquisition of twelve 
objectives in three domains. In addition to t-he content ij:ems, the test con- 
tained ten items dealing with studervt backgrouti<^ information. Both the content 
vand bd'ckground Information items were presented in multiple choice format. 
Every content item had five fpils or distrac^rs of which four were possible, 
answers, while the last was *'I ^don't know'^ Students responded to the test 
items by marking their response on a mark-s^ense card which had been specially 
designed for the^ Grade 8 MathAiatics Assessment. 
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The background informatlon/als^ showed that over ninety-five percent ^ 
of the Grade 8 students spent oite ho,ur or less , per day on mathematics 
homework and that about fifteen percfent of these spent no time at all on 
mathematics homework/ Almost /thirty petcent of t|ie students had used a 
hand-held calculator for homework* ^ ^ ' ' \ 

^ ^ ' ' ^ ' 

4*8.1 Backgrpund Information * *'y . ^ ^ 

Based upon 4:he data gathered from- the ten background informa- 
tion items, o.ver ninety percent of ^the Grade 8 students were within 
the normal age range expected and /1300 more boys than girls took the 
test. Almost one out of every fout students had already attended 
five, schools while less than a* thii?d of the students had attended 
only two schools, presumably one elementary school and one secondary 
school. Over two-thirds of the students were attending non-semes tered 
schools and almost niqety percent were enrolled in Math 8 at the time 
f the administration of the test: 

The background information also showed that over ninety-five 
percent of the Grade 8 students spent p|ie liour or less per day on 
mathema^tics homework and that about fifteen percent of these spent i 
no tllme at all on mathematics homework. Almost thirty percent of 

the students had used a hand-held calculator for homework. 

t 

4.8.i, Test Result s ' , ^ 

, 



In the Computation and Knowledge Domain, Grade 8 students per- 
formed satisfactorily on computatioii with whole numbers, common frac- 
tions, and decimal fractions. They also performed satisfactorily on 
the items for Knowledge of Notation and Terminology and Knowledge ibf 
G^ometi?ic Facts* 



Th^ poorest performance by G^de 8 students in Domain 1 was' 
^ with Equivalent Forms tif Rational Numbers. While they did not have 
:^ny particular difficulty changing a common fraction to an equivalent 
common fraction, they did have difficulty changing common fraction 
to an eiquivalent decimal*" fraction and to a percent. . 

The sfudents'. performance on items from the Comprehension 
Domain was mixed, with both strengths and weaknesses being not^d. 
The weaknesses were with items concerning basic fraction concepts, 
selecting the largest common fraction from a list, and finding the 
area of a right triangle. The .lowest performance on the entire test 
was on the order 6f operations item in the Comprehen'Sion Domain. 

The strengths noted in the Comprehension Domain were with items 
^concerning place value with whole numbers and the metric units of capa- 
city/ Students aiso performed well on the item concerning the metric 
units of length. 



Grade 8 students also performed at a satisfactory level on the* 
items of the Applications Domain.- The only weakness indicated was with 
one item dealing with area., They^^rf ormed very well on a word problem 
.involving whole number multiplication^ndon a word probleta involving 
whol^ number division. • 
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4»8.3 Reporting Categories ^ * . 

Mathematics achievement is the. end result of the coalescing of 
a great number of student-based factors, both intrinsic and extrinsic. 
Attributes inherent in th^ student, programatic and curricular variables, 
as well as the effect of environmental variables such as teacher differ- 
ences all contribute in varying and' largely unknown degrees to a given 
student's overall pjarformance. Of the fairly large number of such vari- 
ables which the conventional wisdom, current educational practice, and ^ 
the endeavours of educational researchers have identified as being re- 
lated to ma thematic^l^ achievement, the ones sele<y:ed for scrutiny in the 
Grade 8 Mathematics Assessment were age, sex, number of schools attended, 
use of hand-held calculators, and time spent on mathematics homework. 

Age Differences ~ On el^en of the twelve objectives, the perfor- 
mance generally increased with a decrease in age, yThe performance of the 
twelve years or younger group ^as not as good, as ^e thirteen yea^ olds* 
but it was never less than that of the fourteen year olds. The fifteen 
years or older group's performance was an average of about eighteen per- 
cent below the provincial mean. 

'Sex Differences — Each group perf6rmed' better than the other on 
six of the objectives, but' of the six objectives on which the girls ob- 
tained the higher performance, five were in 'Domain One. 
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^Number of Schools Attended Those Grade 8 students who had atten- 
ded two schools performed better than all of the other groups on every 
objective. The pattern exhibited was that the fewer schodls attended, 
the higher the performance. The single exception to this -pattern was the 
one school group which had^ the second lowest performance on eight of the 
twelve -objectives. 

Use of Hand-HelH Calculators — Students who used a hand-held 
calculator at home outperformed the students who did not use a hand-held 
calculator at home on eleven of the twelve objectives. Students who used 
a hand-held calculator to do their homework had .higher performance than 
the non-users on eip.ht of the twelve objectives. The two groups tied 
Objective 3.1, afid the non-users' performance was higher on three obje 
Interestingly, those three objectives on which the performance was higher 
for those students who do not use a hand -held calculator for their homework 
were ♦all computationj^l objectives. For the category concerning whether or 
^ not Grade 8 students used a hand-held calculator at school, the pattern 
^ was reversed and very consistent. Students who did not use a hand-held 
calculator at school outperformed. 4;he students who did on every objective. 

Time Spent on Homework — The group that did spend some out-of-clas's 
time on mathematics assignments,, but less than thirty minutes per day, 
outperf omjed the three other groups on every objective. 
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4.8y4 J)ata From/ the Reading Assessment 



In addition to the mathematics test, an assessment test in Reading ^ 
was also given ^at the Grade 8 level. These^two tests contained similar, 
and/Ln somp cashes identical, background information questions. On both 

*th/ Mathem^tio^ and Reading tests, students wfere asked their birth date, 
sex, and number' of schools attended. Using the commoji information, a 
compu ter; search , was able to match and complete reading and mathematics 
data fot< sixty-six p^ercent of the Grade 8 students. ^ A data file was * 

, created to cprftajn the information and results on both tests for the 
matched* students so that ct)mparisons between *theif perf ormat^ces on the 
two . tests fc*oulcf be made^. • The two reporting categories which 'were pr^-* 
seated^ from the Grade 8 'Reading. Assessment concer;ned language and television 
watching • ""^^ ' 

^ Language — • The Grade 8 ^ata were grouped according ^o whether the 
students had been born in Canada, whether they usually spoke a language 
other 'than English before starting Grade 1, and whe their English ^as 
language usually spoken in the home. The results showed the performance 
of the non-Canadian, non-English group to be the best overall. 

Television Watching — Gr^de 8 students who watched- some but less JF^ 
than one hour of television pe| day during the wfek had the test perfor- 
mance followed closely by the group that watched television about one hour • 
per day. The 'pattern among all the jgroups was that the more television 
watched, the lower the performance. The no-television group ranked about 
midway between the -about-three-hours and about-four-hours groups. 

4.8*5 Recommendations ' ^ ^ •^'/"'''''^^'^^ 

Based onj the data presented in this chapter^, the following recom- 
mendations were made. 

Reoormendation 4"! : Due to the increasing importance of the decimal form 
of rational nuiriberSy all teachers of mathematics. should take special care 
to lay the foundation for understanding of the expansion of the numeration 
system to the decimal form of rational mmbers. Understanding of the deci- 
mal form of National nvjnbers should then be used to improve performance 
with the four basic operations using the decimal form of rational numbers^ 

Recorrmendation 4-2 : In future materials produced by authors and curriculum 
developers J the decimal form of rational numbers should precede the fraction 
form. 'The overall curriculum should place much greater emphasis on the % 
decimal form* • f 

Recommendation 4" 3 : Classroom teachers and those involved in the training 
of mathematics teachers should emphasize the importance of instruction in 
geometry in the ele„ientary school mathematics curriculum^ and show future 
teachers the place geometp) holds in both mathematics and everyday life. 
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Reoormendation ^-4 : Teacher of mathematics should emphastze the area 'of 
equivalent forms of rational numbers. Students need many expediences of 
. starting with a rational number in fraction form^ deaimc^ form^ or percent 
form and writing it in the othei^^ two forms. l> 

Recommendation 4-5 : Teabhers should place greater emphasis upon the topics 
of genome try and measurement in their mathematics classes. 

Recommendation ^,4-6 / If th^ (^i^ie>r of operations concept iff to^remain a 
part of the curriculum of the elementary grades^ then teachers must place,^^^ ' 
more emphasis upon it. ' ? - 

Recommendation 4-7 : Teachers of ^mathematics at all levels, must emphasize 
problem solving. Problem solving cannot be just one unit among many; it 
■ should, be given a htgh priority as being central to all aspects of mathe- 
matics. Students must have many experiences of solving multi-step problems 
and they should be taught to verify ^he reasonableness of their answers io 
problems. * * ^ ' ^ 

Recommendation 4-8 : Reseachers should investigate the precise nature of ^ 
the relationship between language background and achievement in mathematics. 
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^ ' Chapter 5 

GRADE 12: RESULTS, INTERPpTATION, AND RECOMMENDATIONS 
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The resultXi^btained on the Grade 12 Mathematics^ Assessment test are 
pTre^ented an^ discussed in this chapter foi; each objective and for each 
item tested. Some df the act/ual itfems from the assessment instrument are ^ 
included as illustrative' examples in order to clarify points made in the ' j 
discussion. " Space limitati^s have made it impos^ifDl^ to include^ every 
item in the present, report • ^ ^^^P^^^^ volipe in this series, Report 
Number 3: - Technical Report, Contains sunmiary'^ in format ion about evdry^'item. 
on each of the three tests. ^ Copies of the Technical Report may be obtained 
.upon request from the Learning Assessment Branch, Ministry of Education. 

5 }l Description ^of the T6st ^ 

Th^ Grade 12 test consisted of se'venty-two iteriS^ designed to assess 
Sttuden-bs' mastery of eleven objectives grouped into the three domains of 
Computation and Knowledge, Comprehension, and Applications. In addition 
to the ^ef^tfematics items, the tefSx contained fifteen background informatio(n 
items which students were asked to coiijplete before' taking the test.^ * 

V 

Students responded to all'items on the test by shading in the appropri- 
ate area on mark-sense cards which were specifically designed for this ttest. 
All items on^the test, were of the multiple-choice variety. For eacl;^ltem, 
,five foils were given. Of* these, four were possible answers ,to the item 
and the fifth' was "I don't know". 

One and,pne-half hours were allotted for the test: thirty minutes for 
instructions, distribution arid collection of the test booklets, and comple- 
tion of the background information items; sixty minutes f of' completion of ^ 
tbp^, Eest itself. 

5.2 Description bf ^the Population ^nt * 

The Grade 12 test was designed JTo be written by. all students enrolled 
in Grade 12, regarclless of their m^hematics backgrounds. According^^to 
statistic^ released by the Ministry of Education the enrolment in Grade 12, 
as of February 28, 1977, was 32 532. Of this number, 23 136 (or 71.1% of 
the total) wrote the test. 

5.2.1 Non- Response and Frivolous Response Data 

For 1975-76, the most recent year for which such figures -are 
available, the absenteeism ratfe for senior secondary schools in the 
province was -calculated to be approximately IQ^. In spite of the fact 
that many observers believe this figure to be a conservative estimate 
of the true rate of absenteeism, the fact remains that a sizable propor- 
tion of Grade 12 'students was not p'resent for the test and that the 
proportion of non-respon^ei^ exceeds the normal absenteeism ra^e. 



The /National Assessment of Educational Progress (NAEP) pro-am 
in the United States has encountered similar difficulties of non- 
participation. In their. first analyses, they assumed that the non- - 
response group was similar in compo^sition to^the whole population and 
that those individuals' failure to, participate would not affect the 
overall item results in any way. Subsequent studies have shown that 
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the non-response group is not exactly similar in composition ,to the 
response group and that failure to takeVhe n6n-response grcvup into 
•account in interpreting the *assessmen.t data' coul-d result in artifici- . 
ally high success rates being reported^qn items 'and objjectiv.e^, NAEP 
has stated that the extent of this inflat-ion is almost certainly not'* 
• great enough^to affect decision-making. \<^r examj^le, a success rate 
of 67% achieved by those responding .to the te^t. might rep'^resent a true 
success rate q^jE ,64% for the entire population, H' ^ - \ - ' ^ ' . 

^ The "non- response problem was also studied for Its iiiq)act 'upon the ^ 
B.C. Mathematics and Reading Assessments. * part of' the background \ 
info^xmation questionnaire on both instrun^ents , students were asWd tQ> 
supply their date of birth, sex, 'master of schools attended, afid'j5chool 
code number. On this basis, 63% of fhe completed mathematics tesfs at ^ 
the Grade 12 level we're uniquely matched with coiiq)leted reading tests. 
The remaining mathematics tests had either no counterpart or more than 
one counterpart in reading or else there was^ more than one mathematics 
'test which had the same answers to the four items upon which^ the 
matching was based. ^ . , X—* ^ \ , 

f . 

The results obtained on the mathematics test by those students who 
had completed botTi the reading and the , mathematics tests were compared' to 
results obtained by th<Jse: who conq)let6d only the mathematics flfest. This 
examination showed that the latter group lowered the success^' rate ty an 
average of less than, one percent on an item. If Ke,assume that the group 
whO' did not write the mathematics test is similar to the group who wrote' 
only the 'mathematics test, then this information tells us^ t)iat the assess 
raeWt results have not been unduly affected by the failure o-f thef non- 
response group to complete the "^Mathematics Assessment instrument. \ ' 

Another mat'ter which was a cause of som^tconcerfi at this level was 
that of students responding frivolously on the test. It was felt by 
^ome that since individual students were not to be identified and'since 
individual student scores were not to be reported, some students would 
make, a mockery of the test and either select answers at randoib, guess, 
ot in some other way respond frivolously . to the items on .the test,^ Two 
measures were undertaken in an effort' to gauge^fche extent of such be-' 
haviour on the part of students .taking the test:* 

. ^ ' \ . . > > 

Firstly, each ccjmpleted mark-sense card was H'aiid checked for complete- 
ness- bnd for obvious patterns of frivolous response, such as the constant 
use (^f a s*l|tgle response category or the repetition of .a series of 

responses: ABC ABC ABC /Thirty-two such instances (0.1;^ of the 

^tal) were found. Secondly, a computer ^nalysis was undertaken to 
Ic^itify those students who had, in all' likelihood , responded by guess- 
j^ng^ by selecting answers at random. Since eacR item had five' foils, 
lose students who had fewer than 20% of the l^-ems cotirect may have 
responded frivolously.^ In all, 208 such cases were found. A 

In. summary, t^e best data available af this, time lead to the conclu- 
sion that, 'desjiite the^ fact that a sizable proportion of the Grade 12 
pdpulation failed to take the Mathematics Assessment test, tfie overall 
results obtained are an .accurate representation of^he^total pop,ulation. 
Moreover, ana Ixp is 'Of Jiidividual students' res|W)nse patterns Has failed 
to turn up. any evidence of widespread lack of due care and attention in 
completing* the test. " ^ ^ * ' - 
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There were approximately 800 more 'isij'ls than boy^ yho*^ook the^ 
Mathematics A^essment test. The percents represented iQjTable 5-1 
correspond fairly wlftl with tfie data on s^^istribution collected 
by the Ministry of 'Education* which shows the Grade 12 pop.ulation to 
be 49% male and' 51% .female. 



Table 5-1 n ( 
Grad«^ 12:^^' Sex of' Respondents 



Sex 

./ ^ 


Frequency ^ 


^ Percent 




' Hale 


- . ) 11 069 


47.8 * . 




Female 


11-831 


^1.1 \ 
/o.8 ' 
0.1 




No Response 
Multiple, Response 


^ 202 

34 





Further analysis of this va^'iable was conducted, takingv^n^ account the 
highest level of mathematics complete5rox being compl^:ted by thp re'sponr 
dent. The data. shown in fab le 5- 2^^iAlustrate the fadt that feipales are 
under- represented in senior matnemafcics glasses. Although they constlr 
tute 51%^of the Grade 12 .population a^a whole, they accounf for'^l^y ^ 
43% 'of the enrolment in Math 12.. On vie other hand, they form close to* 
65% of the group which -takes no mathematics beyond Math 10,' the last ' 
compulsory mathematics course. Less th'aii one third of the female 
students have taken 4lath 12, while almost half the maleSv-have done so. 



Table 5-2 



Grade 12 : 



Percent Distribution of Marh'ematics Background by Sex 



tast Mathematics Course Taken or Being faken: 
l4th 12 Math 11 'Math 10 
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Male 


56.7 


45.1 


34.5 


Female 


42.5' ' " 


53.9' 


, ' 64.^2 


No Response 


0.5 


0.7 


0.9 


Multiple Response 


0.1 


O.l'' 


0.2 



Recommendation \-2 : -The t4inistry of Education should institute a program of 
research designed to ascertain why such a high proportion of female sU^nts 

do not continue to study mathematics beyond the last contpulsory coup^\f 

it ^ .. 

commendation 5-^2 : On the basis of the evidence obtained as a resulp of the 



implementation of Recommendation 5-^ the Ministry of Education^ i&i coopera- 
tiortsWith local school districts and teachers^ graupB^ should ineti'^te pro--, 
fess%qnal development programs to sensitize teachers and counsellors*" to this 
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'and with ways of dealing with it. 

lis 
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The' assessment instrument wafc administered during the month of 
March 1977* As is shown in Table 5-3, there was a fairly broad range 
of ages represented among th^o^ responding/ ' 

^ ' * . • ft . * 

Tkble*5-3 A 





Grade 1?:' Age of 


Respondents 






$ ~ 


. Age 


Frequency 


Percent 


21 or older 
20 
19 
18 
17 . 
16 
15 

14 or younger i 
. No Response, 


57 
277 
1 055 
7 127 
13 993 
. 419 
36 
22 
150 


^ 

0.'2 • 

1.1 

4.S. 
30.8 
60.4 
^ 1.8 

o'. i 

0.0 ^ . 1 

'0.6 









\tudents were asked to provide the day, month and year of iheir birth 
on the respon|e card* Those at either extreme, but particularly those 
reported as being less than fifteen years old, may have marked the 
wrong year since it seems unusual that 22 fourteen year olds would be ' 
completing Grade 12, ^ ; ^ 

5»2»4 Number of Schools Attended ^ 

■ — ] — : — . N ' , 

As with Grades 4 and "S, the data on'number,of schools attended by 
students in Grade 12 reflect a high degree of mobility among the general 
population". ' ^ - ^ 

_ . ■ Table 5-4 " 
■* Grade 12:' Number of Schools Attended 



Number . Frequency Percent 



1 . • - ^ 335 , . • _^ 1.4 

'2 2 602 11.2 

3 • • 6 304 • 27.2 

A ' 5 2|lf - 22.6 



,5 Y • 3 339 . 14.6 

•6 -2 020 8.7 

7 1 218 5.2 

8 - 9 , 939 » 4.0 

10 or more ^ 917 * 3,9 

No Response 101 . * 0.4 

Multiple Respons^i 70. 0.3 



By the time students reach this level, they wbjild normally have ' 
attended a minimum of two school^: an elementary/scl\ool and a 
secondary schqol^ The results summarized in Table 5-4 indicate that 
only about /12% of these students had attended two or fewer schools 
siace. starting Grade 1. They also show that 15j% of the students have 
attended at least seven schools and that approximately 4% have attended 
ten or more schools. Such students have changed schools almost every 
year. r-k .^^'^ , - ^ ' 

5*2*5 Sepjfestered vfefsus Non-rSemestered Courses ^ 

Almost ^60% of the students responded affirmatively to the question, 
"Is the mathiematics course you are now 'taking (or was the mathematics 
course you .have most recently taken) a semestered course?" **This is 
almost the reverse , of thfi^ situation at Grade^S level, where 68%. reported 
that their mathematics course was non-semestered^ 
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Grade 12: 



Table '5-^ 



Perc€nt of Semestered vs, Non-Semesterecl Courses 



TOTAL 



Math 12 



Math"' 11 



Math 10 



Semestered \^ 


59.1 


61.7 


60.9 


48.1-^'" 




' Non- Semestered 


39.0 


37.1 • 




_'4<4 




No Response 


1.4 


0.6 


U.4 "-^ 2.0 


0 


Multiple Response 


0.3 


0.4 . 




"0.3 





As the data in Tat>le 5-5 indicate, about 62% of the Math 12 stud- 
ents are taking or have taken the course in one semester rather than 
over the entire school year* On the other hand, only 48% of the stud- 
ents whose last mathematics course was Math 10 took a semestered course 
at that level. * 

5.2.6 Highest Level of >latheriiatics Completed 



/ 



Since the Mathematics Assessment test was written in the spring and 
not at the end of the term. Grade 12 students were asked both what was 
the last mathematics, course which they had suc^ssfully 'completed as 
well as the name of the mathematics course which they were taking at 
'the time, if any. ^ fairly accurate picture or the mathematics back-' 
ground with which tliese people are leaving thepublic schools may be 
obtained by' combining the data obtained from theS^e^wo questions. 

The data show^ that just over ,80% of the students take at least one 
mathematics course beyond the Grade 10 level, which is the last year in 
which the study of mathefiiatics is compulsory. Unfortunately, it is not 
possible to tell from this information what factor or factors may be 
at work -to influence students to continue their studies of mathematics* 
Among the possible factors are the admission requirements* to university 
but, as will be seen later (sectioa 5.2.10), only slightly more than 
30% bf the stu^^nts have decided to continue their education at the 
post-secondary level in academic programs. 



120 



i 



Ta^le 5-6 

,Grade 12: Highest 'Uvel of Mathe.matics Attained . , 





Course 


♦ Percent 




% 




Math 10 , 


15*1 


r 






Math 11 


45* 8 ^ 








. Math 12 


. 37a 







5*2*7 Part-Time Employment v^^;^^vW^' ^ 

/ ^ • * t ' 

The data collected' regarding the question of part-time employment 
show that over 50% of Grade 12 students are involved in sucl^Ta^rtiVities. 
Th^ majority of such students work at their part-time jobs b^h during 
the week and on weekencis. Students whe--had no such employment did not 
respond to this item. ^ ^ ^ ' 

^ • * 

^ ^ • Table 5-7 \ ^ 

Grade 12: Part-Time ^^loyment 



No. of Hours /Week Frequency Percent 



« 1-5 '1 136 4.9 

5-10 3 518 "'^15.2 

^20 • 5.232 22.6 

More than 20 2 444 10.5 ' 

No Response * 10 784 ^ 46.6 j 

Multiple Response .22 ^ 0.0 ' 

The rate of students^ involvement in part-time employment appears 
to be independent of their mathematics backgrounds. Of the students 
enrolled^ in Math 12, 53.2% indicated they had part-time jobs. For 
thoise whose last course was Math 11 Q^^O, the figures were 54.8% and 
"^1.1% respectively. <. , . 

5.2.8 Use of Hand-Held Calculators ^ . ^ 

' * * s 

Students were asked to respond to three questions concemin-g the 

extent and nature of their use of hand-held calculators. The 'data ob- 
tained from their responses are summarized in Table 5-8. 

For each category of use, about otie-half of the students indicated 
that they had at soma^time employed a calculator. However, when these 
data were examined in the light of mathematics background, some inter- 
esting comparisons became /apparent. In the Math 12 group, almost 75% 
said they have used a. calculator in school, whereas only* 29% of the 
Math 10 group had done so. Similarly, almost 80% of the Math 12 group 
had used a calculator for homework, but "only 34% of the Math 10 group 
had done so. i . 
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Grade '12 ; 



Table 5-8 

Use Hand-Held Calculators' (pircents) 



culator : 



'do You Use-,a Hahd-Hel'd C^lca 
At Home? . For Homework? 



in School? 
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Yes . ' 50,6 

No V 48,0 

No Response 0» 8 

Multiple Response 0, 4 



55-7 
42,7 
1,1 
0-3 



51.2 
47,-4 
l.l 
0,1 



The possible ap^licaftions and educational impact of the use of 



^ 



.hand-held calcul;^ors in school are areas that require intensive re- ° 
sparely and devexSpment initiatives, Teach'ers and curriculum developfe^s 
requireT'assistance in identifying areas of the curriculum suited to ^ ' 
calculator applications and in developing appropriate curricular 
mate^als, / ^' 

Reoormendation 5-3 : Curriculum Development Branch should consider the 
im^^t of the u&e of hand-held calculators in mathematics classrooms at 
various levels: primary^ intemediate^ junior secondary^ and senior ^ 
secondary. They should provide gfUidance, and direciime^^^ teachers of :^ 
mathematics regarding the most appropriate uses of such calculators in j 
their teaching. , ' ^ . 



5.2*9 Parents' or Guardians' Academic Backgr 
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Grajie 12 students^ were asked to report on the highest level of 
schooling attained by djieir parents ot guardians, . The information- 
cbnceming this item is summarized in Table 5-?» ^ ' 

Grade 12; Highest Leve^ jjf Education Jtet^^ned 
by Parients or ^Gua*edians 



^ ^-v-- ^ 




i 








Mother or 


Guardian 


Father or 


Guardian . 


■ '■ H — 


Frequency 


Percent 


Frequency 


Percent 


Eleinentary 


1 8^ 


• 8.1 


1 

• 2 639 


{ 

11.4 


Junior Secondary 


4 558 


19.7 


■ 4 377' 


18. 9.. 


Senior Sefcohdary ' 


7 342 


■ .31.7 


4.495 , 


19.4 


Trade School 


1.767 


7.6 


2 258 


9.7 


technical or Some University 


■ 2 256 


9.7 


2 215 . 


9.5 


Bachelor'-s Degree 


906 




■ 247 


5.3 


Graduate Degree- 


654 


2.8 • 


1 278 


5.5 


}. Don't Know 


3 436 


14.8 


4 176 


18.0 


No Response 


330 


1.4 


358 


.1.5 


Multiple Response ^ 




0.0 


93 


;? 0'.4 


* ■ 
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5.2.10 Future Plans , ' > 

The data regarding students' plans for the immediate futur-e are 
presented in Table 5-19 In percentage terms. Results are reported 
for the population as a whole as well as for three subgroups deter- 
mined by the students mathematics backgrounds, "Math 12" refers to 
students who have taken or are taking Mathematics 12', ".{lath 11" and 
"Matl^ 10" refer to 'the corresponding groups of Grade 12 students 
for whom some form of MathematiQS 11 or of Mathematics 10 was the 
hip;hest level successfully completed. 

Table 5-10 

Grade 12: Students* Future Plans (Percents) 



I 




"Total 


Math 12 


Math 11 


Math 10 

t 


Go to work 




19.2 


7.2 


"23.8 


34.2 


Business school 




1.9 


0.8 


. 2.5 


2.9 


Vocational, Art or Trade 












Training 




9.1 


4.1 


12.0 


12.4 


Technical Institute- 




. 6.1 


,9.8 


4.8 


2.8 


Community College: 












Pre-University 




10.1 ' 


14.5 


9.0 


3.8 


Community College: 












Career Programme 




7.9 


5.3 




9.6 


University 




21.1 


40.5 


> 11.8 


3.2 


Other 




9.1 ' 


5.2 


10.4 


13.7 


Undecided ^ 




13.4 


11.4 


14.5 


15.0 


No Response 


r 










0.9 


0.4 " 


0.8 


1. 1 


Multiple Response 




0.4 , 


0.3 


0.4 


0.8 



Several trends are clearly discernible from the data. A/ large 
proportion of the Math 12 group, 55% to be exact, expect to enroll 
either in pre-university programs at community colleges or in univer- 
sity. On the other hand, only 7% of the Math 10 group had similar 
plans. Only 7% of the Math ^12 group plan to ent^r the labour market 
upon completion of secondary school, whereas almost 35% of the Math 
3,0 group plan to do so. In all three subgroups, between ten and 
fifteen percent have yet to decide upon their future^ plans, 

5, 3 Test Results: Knowledge and Computational Domain 

The seventy-two mathematics content icenis \;ere divided among eleven 
objectives, with the objectives being grouped Into three domains: In 
this section the results for the Computatation and Knowledge domain are 
reported for each qbjective and for each item. The following information 
is provided for each objective:. 

1) the i^tem numbers pertaining to that' objectdve; / 

2) the percent of., students who 'obtained the correct ^swer;- «^ 

3) the judgment of the Interpretation Panel concerning the acceptability " 
of the result, . , • 
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5,3*1 Computation wj.th Fractions 



The test contained four Items Involving computation with rational " 
numbers expressed In fraction form, one Item for each of the four basic 
operations of addition, subtraction, multiplication, and ^dl-vjlslon. The 
results are summarized In Table 5-11, 

Table 5-11 , ' 

Grade 12 Results (N = 23 136) 
Objective: Computation with Fractions (mean 83.3%) 



Ip 



Item No, Operation Percent Correct Panel Judgment. 



2 


Addition 




86 


Satisfactory ' 


6 


Subtraction 




86 


Very Satisfactory 


11 ■ 


Division 


74 


.Satisfactory 


29 


Multiplication 




87 


Very Satisfactory 



The Interpretation Panel found these results to be quite satisfac- 
tory. They considered the Items to be relatively easy and recommended 
the Inclusion of Items Involving mixed numbers on future assessment tests 
at this level. 

It is true that the items used werSe easy, although they did Involve 

most of the major rconcepts and skills required to perform the operations, 

^ • 1^1212,5 .3-5 
The exercises used were: •^t + 't T""T T^T X ^ T u -i^-^^,^ 

2 3, 5 3, 3 7, ^ H /• Had the items 

3 5 > ' 

been more difficult, e.g., 4^ - 2—* it would not be as clear whether the 

students' incorrect responses were due to the difficulty of the item or to 
the students' Inability to use the appropriate algorithm, Jhese results 
indicate as a group, GradeVl2 students are able to perform the 

basic operations 'on fractions. 

The fact that students' pe rformance^ in , division of fractions is some 
12%^ lower than tlfeir performance on the other three operations, is not 
surprising. The algcWrithm frequently taught for this operation ("invert 
and multiply") 1^ difficult to make meaningful, the operation is rarely 
used, and students get relatively little practice in using the operation, , 

5,3,2 Computation with Decimals 

The teaching of both decimal concepts and pomputatJon with decimals 
has traditionally been delayed until the analagous topics with fractions 
have been considered, ""All too often this has meant that there has not 
been sufficient time available to do an adequate treatment of decimals* ^ 
because the fraction work h^s consumed so much time, SucH a situation 
is doubly unfortunate now, since with Canada having adopted the metric 
system of measurement, there will be an increasing use of decimal nota- 
tion and computation accompanied by a decreasing need for fractions. 




r 
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There were five items dealing with computation with decimals on 
the XSrade 12 test. The' results obtained are summarized in Table 5-12 

Table 5-12 
Grade 12 Results (N = 23 136) 
Objective: Computation with Decimals (mean = 80.2%) 



Item No. 


Operation 


Percent Correct 


Panel Judgment 


1 . 
5 

15 
17 
28 


Subtraction 

Multiplication 

Addition 

Subtraction 

Di>WLsiori 


< 87 
78 ' 
84 
86 
66 


Satisfactory 

Marginally Satisfactory- 
Satisfactory 
. Satisfactbry 

Marginally Satisfactory 



The Interpretation Panel felt that these results were weaker than 
the results for computation with fractions. . In particular, they recom- 
mended that increased attention be paid to mult i,£licatljDn^ and division 
of decimals as well as to place value concepts. • 

The two items, 5 and 28, which resulted in marginally satisfactory 
performances by the students, are shown in 'Figure 5-1. 



5. Multiply: .15 x .45. = 



A) 
B) 



6.75 
0.0675 



Percent 
11 

Zfi * 



28. Divide: .12 ) .036 



C) 0.675 

D) 67.5 ' 

E) I don't know 

No Response 



8 
1 

1 

r 



t 



A) 3 

B) 0.003 

C) Q.3 



Percent 
5 

13. 



D) 0.03 

E) I don't know 

No Response 



13 

2 
1 



Figure 5-lJ Grade 12 - .Items 5 and 28 
* the correct response is underlined 

For each item above, the same non-zero digits are used in each 
distractor so that the questions involve proper placing of the'' decimal 
point in the answer more than they do ability to use the multiplication 
or the division algorithms. In light of this fact, the students' per- 
formance on t^ese two items would certainly appear to be le*ss than 
satisfactory. 



■ erJc 
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5.3.3' Knowledge of Notation and Terminology 



129 



Table 5-13 
Grade 12 Results (N 23 136) 
Ojecti'ver Knowledge of Notation and Ten^inology (mean 



75. 



Item No. 


Topic 


.Percent Cdrrect 


Pane! Jud^ient 
^ . ' \ ^ / 


3 


Sqviare Root 


87 • ' 


Very Satisfactory 
Strength • * | 


' 7 


Factor 


86 . 


9 


Powers of 10 




Satisfactory 


10 


Scientific Notation 


^ 67 


Satisfactory,,- 


20 


Centimetres 


.* 69 


Marginally Satisfactory 


.30 


Exponents 


87 


. Very Satisfactory 


34 


G.C.F* 


78 


Very Satisfactory 


39 


Obtuse Angle 


62 


Marginally Satisfactory 


40' - 
42 


Diameter 
Solids 




Satisfactory 
Very Satisfactory 


44 


Reciprocal 


90 


Strength 


45 

51- . 


Primes 
Coordinates 


65 
72 


Saiislactory 
Satisfactory 


62 


Roots 




Satisfactory 



The Interpretation Panel felt that there was a gen^l we^ess 
in the area of geometry, and that geometry should receive greater empha- 
sis in the future. They felt that, particularly for^aca^^mlc students, 
the geometry should be deductive and not merely intuitive. Items 7 and 
44 were particularly well done. \ 

». » 

For Item 9^, students were asked to simplify IQ^ and "almost 20% ' 
dhose 1@0 000 rather than 10 000 as their answer. On the oth>r*hkod, 
on Item 30 'which asked students to simply 4 performance was consider- 
ably better. It would appear that students may have bfeen taught a rule 
for evaluating powers of 'ten (10 is*^ 1 .followed by n zeroes), hui have 
not remembered the rule correctly. This same item appeared on the 
Grade 8 test, where 12% chose 100 000 as the answer.. 




The results on Item 20, which is shown below, are surprisingly 
low, given the level of difficulty of the 'question. ' 



20. 5 metres is the sarae length as: 



A) 50 centimetres 

B) 500 centimetres. 



.C) 50 millimetres. 
D) 500 n}il I i metres > 



Percent 
15 

63 



4 

4 



ERIC 



/don't know 13 
fjo Response . < ^ i 

■ ] i26 

Figur;^ 5-2j Grade 12 - Item 20 
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Inability to obtain the correct answer .to '^I ten) 20 would seem do 
indicate an almost total lack of familiarity with the basic relation- 
ships among the metric units of length; in this case, the students 
seem unable to ipake use of the fact that one metre is the same length 
as '100 centimetres. This low performance is particularly serious at 
the Grade 12 level ^ince many of these students are in the final yeir. 
of formal education. In the metric world in which chey will be adult's; 
familiarity with the metric units of length li^ill be an important assest, 

5.3;4 Knowledge of Other Algorittigja^ ^""^^ ^ 

In addition to' the four basic operations on whole numbers, frac- 
tions, md decimals, students are taught algorithms for performing a 
wida.j«fiety of mathematical operations* Some of these oper^ons are 
reducing 'fractions to lowest terms ,^ simplifying improper fraSfeons, 
chan^g*^ decimals to percent s to fractions and vice versa^^ operations 
,witir integ^s, and simplifying exp^ressions containing exponents. 

Seven items on the Grade 12 test were used to sample students' 
abilities to employ such algorithms. The results obtained are shown 
in Table 5-14. ^ / 



Objective : 



Table 5-14 
Grade 12 Results (N = 23 136) 
Knowledge of Other Algorithms (mean = 72. 



7%) 



Item No. 



Topic 



rPercent Corrett 



Panel Judgment 



% 
8 
13. 
16 
31 
35 
46 



Integers 


n. 31 


Integers 


66 


Percent ^ 


79 


Exponents 


59 


Decimal 


• ' 67 


Decimal 


65 


Lowes.t Terms 


92 



Very Satisfactory « 



Satisfactory 
• Satisfactory 
Satisfactory 
Marginally Satisfactory 
Marginally Satisfactory 
Strength 




Items 13 and 35,\which are" shown below in Figures 5-3 and 5^4, 
concern writing a fraction as a percent and a percent as a decimal.. 
As the 'Interpretation, Panel commented, skills tested here are basic 
knowleflge of importance to everyone. The performance in this area 
needs improvement. ' 



t3. 



Written as a percent, 

• • ' Percent 



1. 
5 



35. Written as a decimal, 



20% = 



A) , 5% 

B) .0.5^/0 

C) 20% 

-4- 



'7 

12 
79 



> D) 50% II 

•\ 

E) I dorv't know ir 

No response 1 

Figate 5-3: Grade 12 - Item 13' 



A) 


.0-2 ^ 


Percent 
65 


B)' 


0.02 


10- 


C). 


2.0 


4 


D) 


20.0 • 


18 


E) 


• 1 don't know* 


. 1 



l^7 



Figure* *5-4: Grade 12 -^^Item 35 



alsp 



Item 31, alsj rated as margiyially satisfactory,, required .stud- 
ents to Express 1/8 as a decimal. IVlmost 20% of the students selected 
0.8 ag thlir response, simply placing the denominator of the fraction 
after the decimal %point. The perforaance ^on Items 8 and 16 were , 
rated satisfactory despite the relatively low percent correct on each 
because the content; of these items wa(fe judged to be less essential to 
all 'Student^. Item 8 asked students to find the difference of two ( 
integers (-5) - (-9), while in Item 16 students were asked to apply 
laws of exponents in order to simplify 3^ x 3^. It will come as no 
Surprise to teachers of mathematics that' 24% chose as their res- 
podse to the latter item. 
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5.4 Test Results: Compjtehension Domain 



'Fdbr objectives made up the Comprehension Domain. These objective^ 
dealt with the comprehension of number c^oncepts, of measurement concepts, 
of geometric concepts, and of algebraic concepts. Comprehension, as a 
cognitive behavfour, is higher than Computation and Knowledge. ^ 
Comprehension, as it is used here, includes knowledge of concepts, princi- 
ples, rules, and generalizations as well as the ability to transform problem 
elements from one mode to another and the ability to read an^ interpret 
problems. ^ ^ * * 

5.4.1 Comprehension of Number Concepts 

By the end of Grade 12, all^students have been exposed to the field 
of rational numbers. They have studied the^arious forms in which 
rational nujnbers are written as well as methods of performing operations 
on sucK numbers. The test -items utilized for this objective were de- 
signed to assess students' grasp of a selected number of important con- : 
cepts-, principles , 'and' generalizations concerning rational numbers. The 
res^tlts obtained are summarized in Table 5»-15. t 



v> Objective: 



Table 5-15 • 
Grade 12 Results (N - 23 136) 
Comprehension of Number Concepts (mean =.67.7%) 



— ^ ^ f — ^ 


Item No. 


Content 


Percent Q 

' 1 


Direct' 


/ 

Panel Judgment 

■ — I — 



12 


Division with 0 . 
Order ^ 




■ t 

Satisfactory 


14 




Very Satisfactory 


18 


Fraction 




Weakness 


32 


Square Root s 


73 


Satisfactory 


\7 


Order • 


59 


Ma-rginally, Satisfactory 


■ 50 

♦ 


Rounding 


75 


Satisfactory 
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5»4»2 Compyehension of M&asureTPe^t Concepts . ^ * 

Th6 Grade 12 ^asse^sment instrument included f"ive^tems dealing 
with comprehensiop measurement concepts, Of'these,one item,- Item 
43, d.ealt^with measurement of angles -and the remainder dealt w^^h- the 
metric s^stenj of measurement. The data concerning this objective are 
• presented 'in Table -5-16. . 



Objective : 



Table 5^16 
Grade 12 Results (N = 23 136) 
ynderstanding of Measurement Concepts (mean = 78. 



? ■ 


Item No. 


Content 


Percent Correct 


Panel Jud^ent^ 
t 





4* 



19 
21 
22 
23 
43 



Temperature 
Capacity 
Mass 
Length 

Angle Measure 



87 
90 
54 
8^ 
81 



Very Satisfactory 
Very Satisfactory 
Weakness 

Very Satisfactory 
Satisfactory 



On all five" l\:^ms, the students were asked to select the most 
reasonable rfeasure frdm among four possibilitl^es for a given situa- 
tion. The Interpretation Panel expressed the opinion that the result^ 
obtained were satisfactory pr better except for the per formance ^on Itdm 
* 22. They felt that this low performance was understandable f orlS^de/ 
12 students at this time. 

If one includes ItemJfO which was ci^scussed earlier along .with 
Items 19, 21, 22, and 23,''^tl;ien a general indication of students' famijl-^ 
"iarity with the metric system can be obtained. The average for all j 
, five items is 75^.3% with one resul^^'(Item, 22) being rated as a weakness, 
fitem 20 was marginally satisfactory, and the remaining three items were 
very satis.factory . ^ 

Overall the Students seemed to be fan\iliar with some of the b^ksic 
metric concepts' although the relationship between metres and centimetsres 
as'' well as the use of the .kilogram as the unit of mass are somewha'fe-^eat 
It is important that steps be taken to ensure that all s-tudents become] 
familiar with t|ie metric system of measurement before they leave school. 

Reoormendation 5^4 : Schools and school districts should implement, pvogvam^ 
to familiarize all af their 'student^(^/^ut especially those at 'the senior 
secondary levels ytth the basic concepts and'^principles of the metric system 
of measurement*'^^ ^ . ' f . 

5.4.3 Comprehension o^ Geometjric Concjepts 

Table 5-17 contains a summary of th^e information concerning the 
four items used to d^sess students' understanding of geometric concepts. 
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' ' y>Table 5-17 
• Grade 12 Results (N =^ 23 136) 
Objective: Comprehension of Geofaetric Concepts ' (mean* = 57%) 



Jtem No, Content ' Percent Correct Panel Judgment 



38 Equilateral Triangles 75 Very Satisfactory 

41 Congruence " 17 * ■ 

52 Area ^ > Marginally Satisf act^Oj^ry 

54 Volume 81 Very Satisfactory 



^ The Interpretation Panel feltl that the overall performance on 
these Items was satisfactory or better. They attributed the students' 
poor performance on Item- 41 to the nature of the item itself, and 
felt that the result did not truly reflect— students ' understanding of 
coixgruent tt^iangles. For that reason, no Panel Jud-gment has .been 
listed for ^tem 41, 

• 

The results of Item 52 deserve ^some' attention. On this item, as 
is ?hown in Figure 5-5, over one-qimjrter of the students deteirmined 
the area of the triangl^by simpTyf inding .the product of the base 
and the altitude. Another ten percent said they did not know how to 
fin^ the area. ' . ' , « 



S2. Find the area of this right triangle: 



A) 42 



Percent 
55 




B) 20 

C) 84 

D) 21 



5> 
26 
3 



E) 

Figure 5-5: Grade 12 - Item 52 



don't know 10 

No Response 



The formula for finding the area o~f a triangle is on6 of the most 
basic area formulas, and is one which is taught to all students at 
several grade levels. The fact tha<: almost half the Grade 12 students 
could riot do this item correcf ly must be interpreted aip a less than 
satisfactory performance and, perhaps, as a weakhes^. *^ 

The Panel's comments to the effect that Item 41 is a poor item^aiid 
does not relate to the objective should be accepted with a degree of ^ 
caution. The item, shown in-Figure 5-6, "requires students to select 
two triangles* that ARE congruent, not triangles that appear to be con- 
guent. " * ' 
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41. Which two triangles are congruent? 

,^ Percent 

A) I and Tg" 

B) landn 

C) /land HI 

D) tfand 31 

E) I don't krjow 10 




D H 



II 




Figure 5-6: Grade 12 - item 41 . 

Sixty-five percent of the students chose the triangles which are 
equiangular and therefore similar, I and III, but not necessarily con- ' 
gruent. Such students may have looked for triangles which appeared to 
^e congruent rather than using their knowledge of/ congruence conditions 
to answer the question.. On the other^hand, if students did reason in 
that way, then why did they not choose I and IV, 'which was tshe first ^ 
digtractor and where the triangles certainly appear to be congruent- since 
indeed they are? Although it i^ impossibl.e to be certaifi,> a reasonable^ 
explanation of the students' selection of distractor C is that they er- * 
rpneously concluded that if two triangles are equiangular, then they 'are - 
congruent. In this light, the performance on Item 41 may be seen to 
indicate a weakness. ^ ^ 

5 • 4 . 4 ComprehensiorSof Algebraic Concepts 

«^ 

Few of whaty most people would consider as algebraic concepts are 
among the essentiat skills and concepts of mathematics that one needs 
to lead a full and happy life. However; all of t^e ite?ps listed in 
Table 5-18 measure mastery of 'fundamental principles, rules, and the 
ability to apply formulas to which ail\ students^ are exposed before the 
end of Grade 10. Thus, through it-may be true that all of thefe concepts 
are not^essential in everyday life; it is true that some of them are 
essential in 'mathemafiCs. 

Table 5-18 \ ^ 

Grade 12 Results (N = 23 136) 
Objective: Comprehension Crf Algebraic Concepts (mean = 63.9%) 



Item No. 



Content 



Percenf Correct 



Pjnel^ Judgment 



48 ^ 


Order of .Operation s 


67 


55 


Slope 


43 


56 


Evaluate Expressions 


83 




'Linear Equation 


82 


61 ) 


Factoring 


.61 


63 / 


Simultaneous Equations 


63 


64 


Simplify Expressions 


- 44 


67 


Write an equation 


• 70 


68 


Apply Formula 


■ 62 



Satisfactory • 
Marginally Satisfactory 
Very /Satisfactory ^ 
Very Satisfactory 
Satisfactory 
Very Satisfactory 
Marginally Satisfactory 
Very Satisfactory 
Marginally- Satisfactory 
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In the opinion of the^ Int'e^retation Panel, the results for this*^ 
objective were very satisfactory 4 The areas which were judged weakest, 
finding the slope of a line and rWoving parentheses to simplify^ a 
linea-E- expression, they felt to beXonly marginally useful to non- 
academic students. They suggested that the low result on Item 68 (Fig- 
ure 5-7) might indicate a need to deal mo^e adequately with the topic 
of interest, and perhaps especially for academic students. 



135' 



The formola to calculate simple interest is / = Prt where / is the 
interest, P is the principal, r is the rate, and t is the time in years. 



68. Find the Interest on a principal of 
$1000 invested for two years at an 
annual rate of 7%. 



A) 


$ 140 


Percent 
62 


B) 


$1400 


12 


C) 


$ 70 


12, 


D) 


$ 14 


'.-6 


E) 


1 don'f know 


» 7 




llo Response 


2 • 



Figure 5-7: Grade 12 - Item 68 

For Item 68, students were given the simple interest formula^ and 
asked to calculate an amount of interest due. The behaviours involved 
are not unlike those involved in finding the area of' a triangle, (Item • 
52) except that in this case the formula is provided. 

^ Almost A0%. of the students werer unable . to do this exercise a&d 12t ' 
gave the completely unreasonable response af * $1A00 as^being the interest 
due on a principle of $1000 after two^ years^at a rate, of 7%. The ;f act 
that so many students cannot calculate , simple interest, given the fof" 
mula, should be a cause of some concern to mathematics educators. In 
point of fact, an examinatim of ail of tfhe ite.fts on the test which deal 
with percent and applications of perceht leaves one with the Impression^ 
that this is a general area of less than satisfactory perfohnance. 

Reoormendation 6-6 : ^urrioulm Development Brcmoh should exanrLne the 
situation with regard to the teaching of percent and its applications ^ 
and give specific suggestidns to teachers regarding appmpriq,te mater- 
ials and methods to be used in teaching these topics^ ^ " ; ' 



5.5 Test Results: 



Applications Domain 



Included under the A^lications domain are the abilities^ to solve, rou- 
tine problems, analyze, data, and recqgnize patterns. Eightjeen items , grouped 
under three objectives, were used to assess student learnings in this domain. 
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5.5.1 Solve Problems Involving Operations with Whole Numbers , ^ 
Fractions, Decimals, and Percent 

In a sense, almost all problems in mathematiJs; involve operations 
with whole 'numbers , fractions,- decimals, and percents; however, the 
inteijtion is to include here those problems which involve such opera- 
tions ^and nothing more. In that sense, 3uch arithmetic problems are 
distinct from geometric or algebraic problems. 

The tes% included nine arithmetic problems, and. the results obtained 
f by the students on theSe items 'are presented in Table 5-19. 

Tab]^ 5-19 
Grade 12 Results (N = 23 136) 
Objective: Solves Arithmetic Problems (mean = 74'. 8%) ^ 

Item No. Topic Percent Correct Panel Judgment 



24 


Unit Pricing 


65 


Marginally Satisfactory 


25 


Credit Buying 


70 


Satisfactory. 


26 


Average 


89 


Very Satisfactory 


27 . 


Discount 


86 


Very Satisfactory 


58 


Percent ^ 


87 


Satisfactory 


59 


Percent 


79 


Satisfactory 


60 


Percent 


66 


Marginally Satisfactory 


71 


Commission ■» 


62 


blargihally Satisfactory 


72 


Tax Table 


69 


l-Iarginally Satisfactory 



^ The Interpretation Panel fePtAthat there was room for improvement 
of students' performance on these D^es of problems. They- wondered if 
sufficient time is being spen-t on the teaching of probleV-solving and 
suggested that the performance would improve if students studied more 
businesSv^ and consumer mathematics topics. Finally , they hypothesized 
that students' performance might reflect 'inadequate training in per- 
sistence, care, and attention to detail. 

The P^nel'-s last comment is an important ^e. There is no^doubt 
that' persistence, care, and attention to detaiX are necessary but not 
sufficient conditions to good probieti-solving. Teachers have similarly 
decried students' seeming carelfissness and inattention to detail 
generations. It may be, however, that students will -improve their 
skills in this area if teachers succeed in brirxging a little of the 
xeal world into the mathematics classroom, thereby enlivening their 
discussions of topics which might otherwise be seen by the students as 
i-rrelevant and hence undeserving of persistence, care and attention^ to 
detjkil. , 
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As thof Panel has suggested, students' performance mi^Jj^ improve 
if more ctSnsumer and business mathematics topics were ta'^ht, espec%l- 
ly at the senior secondary level where they are most likely to be mean- 
ingful to the students. On the Assessment test, the few items ranked 
as marginally satisfactory are all consumer items,, as are two rated very 
satisfactory and one rated satisfactory • 

Special note should be made of Item 72 in which students were shown 
a page from the Canada .Income Tax Guide and asked to 'find the total 
amount rOf tax due on a specified Taxable Income. Just over 30% of the 
respondents obtained the incorrect answer thereby giving some evidence 
of their inability to read a table correctly, a table which many of them 
must have already used and which all of them will use sooner or later. 

Reoormendation 5-6^ Teachers ^and teacher educators should stress the over^ 
riding importance of problem- sblving in i^thematics and they shbuld attempt 
to teach their studants various strategies to emplou in^ attempting to solve 
problems in mathematics, \ \ ^ 



Reoormendation 5-^7 : Individual teachers and mathematics departments should 
set up their am collections of problems and activities out of which problems 
grob)^ keeping in mind the interests of their students^ and making use of 
local information in order thai^ the problems *vilt be more interesting ta 
students. ' . ■ ^ ^ 

Recommendation 5-8 : The Curriculum Development Branch slwuLd give imediate . 
and serious consideration to ways and means of ensuring vnat all students 
completing Grade 12 have been taught the major topics of consumer mathematics: 

5.5,2 Solve Problems Involving Geometry and Measurement 

Seven items were utilized to assess students' abilities to solve 
geometric and measurement problems. The item results are. displayed in Table 
5-20. 



Objective: 


Solve 


Gra^e 12 
Problems 


Table 5-20 

Results (N = 23 136) 

Involving Geometry and Measurement (mean 55%) 




Item Wo. 


Topic 


• 


Percent Correct Panel Judgment 
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33 


Area 


35 . 


Weakness 


36 


Scale Drawing 


81 


Very Satisfactory 


37 


Area 


54 


Weakness 


49 


, Surface Area 


37 


Weakness * 


53 


Area of Circle 


72 


Very Satisfactory 


65 


^ Similarity 


63 


Satisfactory 


66 


Theorem of Pythagor^s^ 43 


Weakness " 














• 


• 




- 
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The results of this objective are poorer than for any of the others. 
The Panel rated four of the item results as indicating weakness. In the 
Panel's opinion, students may^ave done poorly on Item 49 because they 
either did not understand the term "surface area" or else faile.d 
carefully enough. The results show that 33% of the respondents foi" 
the volume rather than the surface area for Item 49, The Panel alsL 
reiterated its previous point to the effect that the students' poorW 
performance may reflect inadequate training in persistence, care, atiB 
attention to detail. - , . \V\ 

Student performance was -very satisfactory on an item involving 
scale drawing. Item 36, and on Item 53 which dealt with the relative 
areas of two related circles. Actually the performance on Item^53 was 
surprisingly good when it is^compared to that on Items 33, 37;' 49, and 
66 . ^ 



! 


8 ^ 

12 






^ 15 ^ 





37. What is the area of the shaded portion 
of this figure? 

Percent 



A) 54 * 



54 



B) 96 16 

C) 120 6 

D) 60 8 

E) I cton*t know 15 

No Response 1' 



V 



^ Figure 5-8: Grade 12 - Ite^ 37 % 

This is a relatively straightforward problem requiring two appli- 
cations of the formula fqr /he area of a rectangle and then finding 
the difference between these^areas ; ^et, almost half the students ,were 
unable to solve it. Fifteen percent responded "I don't know" and an * 
almost equal number simply found the area of the inner rectangle. 

The general impression left by these result's, is -that students are 
leaving school with an inadequate grasp of geometry. In recent years 
the emphasis on geometry in the secondary school curriculum has grfiatly 
lessened. Perhaps we are nqw seeing, for the first time, the results 
of this de-emphasis. • 

Reaormend ation 5-^9 : Curriculum Development Brandh should' re Qon}^r the^ 
nature and scope of the geometry curriculum at the secondary school levels 
1 ^1 ^^^ results obtained by the -students on the geometry items 

5.5.3 Solves Algebraic Rroblems- 
• > 

Only tijo items relevant to this objective were placed on the Grade 
12 test. As a result, the Interpretation Panel found it impossible to 
make an overall comment on the objective. The individual item judgments 
^ are shown in Table 5--21. 
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" Table 5-21 
Grade 12 Results (N ^ 23 136) 
Objective: Solving Algebraic Problems (mean = 5/* 5%) 



C7 » 


• Item No. 


Topic ^ 


Percent Correct 


Panel Judgment 


69 
70 


Use Formulas 
Interpret Graphs 


^< 48 
67 


— ^» 

Weakness 
Satisfactory 











it 
as 
tb 



On Item 70, ,67% of the- .students- were able to read\a graph of 
speed versus braking distance/correctly..^ Although the Panel rated: 
this Derformace as satisfactory, a much Ivigher result woul^ have b 
prefetXed, particularly in li'ght of the ^ver more extensive use of 
graphsyis a means of summarizing and presenting data. y 

Item 69 was a cojnpanion to Item, 68 (see ,7±^}Ae 5-7). F'oB^this 
, students Cere given the interest,^rate, andj time involved and 
-_d to find the 'principal amount. In ^i:d^^r^fi)t do this, -fftey hAd 
perform an algebraic manipulation on the fonntlila in order for it 
to read P = i/rt. As th^ r«ults^show, slightly less than half thei' ''^ 
students were able to obtaiiy£he correct answer. Sixteerff^percent ire- 
sponded "I_don't know" and 17% said $72^ was 'the answer^^ This latter . * 
result is obt^i4Jed"by siiig)ly multiplying aTSJL three^riumb^rs that are 
given in the problem without regard to their application in the formula. 

The Interpretation Panel. again repeated its co!nme at tg the /effect 
that students* performance on these items may reflect inadequte train- 
ing in persistence! care, and attention to detail. - " y 

5.6 Grade 12 Reporting Categories. ^ . ' * ' ' • - ' 

" ^ . \ ^ \ 

Mathematios achievement Is the end result of the coalescing of a great A 
number of stu*dent~based factors, both^ intrinsip and\eixtrinsic. ' Attributes 
inherent in the student, programmatic and curricular variables ^ . as well as 
the effect of en<?ironmental variables such as teacher differences, all con- y 
tribute in varying and largely unknowp degree to-a given Student's overall, ^ 
performance. "Of the fairly large number of stich variables which' the convfen- ^ 
tibnal wisdom, current educ^tionaT practice , and the endeavors gf educatl<5rial 
researchers have identified as being related to mathematics^achievement , a 
Ihirited number were selected for scrutiny in the Mathematics Assessment (see 
Chap-fer 1, Sectiot^ 1.-4). "* - <^ A . 

^' I A great deal more information concealing the relationship between cer- 
tain personal background variables and aci\ievement on the Mathematics 
Assessment test" was collected than could possibly be reported in this vplume. ' 
A more complete rendering may be founds 'in bfie Technical Report dealing with 
test results which is obtainable ^om the Learning Assessment Branch. Re- 
seatchers or others who wish to have access '^o the original data in' order to 

A seek answers to their own questions on j,ssuea relevant to the Mathematics 
Assessment^ should also direct their reqyests ^o the Learning Assessment Branch. 
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In the sections that follow, all of the results reported knA reconnnen- 

dations made aje based upon correlational trends. No attempt/is saade to 

imply that cause and effect relationships exist since the Mathematics Assess- 

, mentvwas not designed to identify such relationships. 

It remains for studies designed ^s follow-ups to the present one to 
' ^eek to identify such rel^ionships-. Thus, while the assessment results 
show several fairly strong relationships between a student's sex and that 
student'^ achievement in mathematics, this does not imply that achieve- * 
ment in mathematics is determined by a student's sex. All that can be 
said on the basis of the assessment data is that there appears to be a 
relati^onship between the two variables. 



For each of the reporting categories discussed in succeeding sections, 
reference is made to the various dipmains, objectives, and items evaluated in 
the Mathematics Assessment. For ease. of reference, a labelling system for 
domains and o"b(jectives has been adopted and will be used throughout the 
remainder of this chapter. Each ob'jective has been assigned a code number 
consisting of two digits separated by a period. . For example, Ojbective 2.2 
refers to Domain 2 (Comprehension), Objective 2 (Understanding of Measure- 
ment Concepts). In Table 5-22, the rightmost column indicates the section 
of Chapter 5 where ^the Grade 12 population results for the appropriate ob- 
jective were initiSll^. dis'^ussed. 

\; V \ ^'^^ ^ 

' ' VTable -5-22 
Grade 12: Co^e Numbers used for Objectives 













rr 

' Location .of 


Code No. 




Objective 




Population Results 
-4 



1.2 
1.3 
1.4 
2.1 
2.2 
2.3 
2.4 
3.1 
3.2 
3.3 



Computation with Fractions 
Computation with Decimals 
Notation and Terminology * 
Other AlgoriOims ' . 
Nufeber Concepts 
Measurement Concepts 
Geometric Concepts 
Algebralc'Concepts 
Arithmetic -Problems 

Geometric and Measurement Problems 
Algebraic Problems" 



Section 



5.3.1 
5.3.2 
5.3.3- 
5.3.4 
5.4.1 
5.4.2 
5.4.3 
5.4.4 
5.5.1 
5.5.2 
5.5.3 
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:> ./6 . 1 Mathematics Background ' 

0 The student population at any grade level is heterogeneous wi,th 
respect to mathematics achievement, but- at the senior secondary levels 
i-t is at its most diverse due to the additional factor of variability 
of student background in mathematics. Students at every level vary • 
greatly with respect to their aptitude, interest, and .ability in mathe- 
matics; but, at the senior secondary level they also- vary in the amount 
of mathematics to which they have been exposed. ' Some have taken no 
mathematics courses since the end of the last compulsory course in. 
Grade 10; at the opposite extreme Others ate enrolled in honours sec- 
tions of Math 12. ' i * 

• ^137 . • 



It is entirely predictable that students with mojr^ background in 
mathematics will perform better on a mathematics test 'that will 'students 
wbo have less. In that sense the results reported here are not that 
extraordinary • On the other hand, it should be remembered that the 
basic goal of the Mathematics Assessment was to obtain a measure of all 
students' a^s^ery of certain essential skills and concepts of mathematics, 
From this point of view it is important to see hoW each subgroup of the 
population performed as well as to examine the achievement of the popu-^ 
lation as a whole. 



141' 



A comparison of students' performance on the Mathematics Assess- 
ment test as a function of their mathematics backgrounds is displayed 
graphically in Figtvre 5-9, Students taking or having completed Mathe- 
matics 12 are designated as Math 12; students taking or having completed 
some form of Mathematics 11 as their last mathematics course, as Ma)tn ll; 
and students completing Mathematics 10 as their highest mathematics 
course, as Math 10. * * 
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Figure 5-9: Grade 12 Results by Mathematics Background 
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The Math 10 group's performance is lowest on .6at:h objective^ and, 
in some cases, it is markedly so^ As wiH be see|iv~ini Chapiter 6, 
this group scored lower than the Grade 8,^roup. oc^^^^ of the items 
which- were coimnon to the two instrumgrits. OA-tW^^|rit'ive side, 
the three objectives Qiere the Math ^0 group'-s ^f^ormance was 
closest to, that of the Math 12 group ^were solution of arithmetic 
problems, comprehension of measurement concepts, and .computation with 
decimals; all three being areas of practical importance and applic- 
I ation» 

, That something must He done to improve the mathematical comp- 
etencies of th^ Math 10 group ^eems abundantly clear from the re- 
sults, especially when one examines the individual ijtem results 
obtained by this group* Of th'e 3 506 students in the Math 10 
group: ^ " . ' 

1) 49% were ab^ to interpret an income tax table (Item 72) • 

2) 49% were $fcle to select the best purchase (Item 24) 

3) 45% were able to read information from a graph (Item 70) 

4) 44% obtained the correct quotient for .12)\o36 (Ivtem 28) 

5) 42% correctly wrote 1/8 as a decimal (Item 31) 

6) 42% correctly calculated an amount of simple interest given 
the JFormula (Item 681)^ 

7) 39% correctly wrote 20% as a decimal (Item 35) 

8) 26% were able to calculate the principal, given the amount of 
interest, the rate, the time, and the formula i = Prt \ 
(Item 69), and 

. 9) 24% were able to find the arear of a right triangle (Item 52). 

/ 

Both the Math 12 and the Math 11 groups perfo'rmed satisfactorily 
on the whole. As was to b$. expected , the averages decrease from one 
domain to the next. The. highest' performance was achieved in Comp- 
utation and I^wledge; the lowest, in' Applications . 

. The graph displayed in Figure 5-10 presents a comparison^of 
student performance on each objective for each of fbur age groupings- 
19 and over (N = 1 389), ^8 year olds (N = 7 127), 17 year olds " 
(N - 13 993), and 16 or younger (N = 477)."^ On each objective the 
performance decreases with an increase in age. 

. Similar differences are found in most cases when mathematics ' 
background is taken into- account along with age. Among both the 
Math 12 and Math 11 groups, the younger students do better than 
their older counterparts. . la the Math 10 group (N = 3 506), on the 
other hand, the handful of students wh^^e sixteen or less~(N = 46) 
do less well than the seventeen year olds on virtually every obiec- 
t ive . . 
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5-6.3 Sex Differences ^ 

As has been reported in other studies such as the National * / 
Longitudinal Study of Mathematics Ability (NLSMA) and the National" 
Assessmeat of Educational Progress (NAEP) , the data displayed in 
Figure 5-11 show a definite trend to superior achievement by males 
in the Mathematics Assessment . Both NLSMA and NAEP reported that 
girls outperformed boys only in those areas ot mathematics such as 
computational skills which involve lower level cognitive behaviours. 
Similar results were fouhd in* this assessmen-t. 



1^0 



GROUP HERN 
IPERCENT) MJ)- 



20 i) ^ 



40 J) - 



90.0 




... .^vvA^^ A 




• • . . • F£nU - W7M JO 



.'.3 iU r!, .,U .,1. ,U ala 

OBJECTIVES 
Figure 5-11: Grade 12 Results by Sex 



same res^C ' ?hp S^ff joathematics background leads to the 

same result The differences between achievement of males and fe- 
males are relatively small among the Math 12 group but they are 
wi.th one exception, in the same direction as for the tota/grou^. 
The differences are greater among the Math 11 group, and even 
more pronounced among the Math 10 group. 

5-6.4 Number 3f Schools Attended 

Th^re was a remarkable consistency of results when they were 
examined in the light of the number of schools attended by stu^ 
dents. For example, there was a tot|al variation of only o'.8% 
on objective 1.1 among students who had attended between one and 
seven schools. On the other hand, those 1 856 students who' had 
attended eight or more schools averaged three percent less on the 
same objective. * , <^ 
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/ The same pattern, applied to ^ach objective. Having attended 

/■ a\Large number of schools, j^ght or more was consistently related 
tq/, lower perfoAiance; otherwise the number of schools attended 
seemed to be^^inrelated to mathematics achievement at the Grade. 12 



5*6.5> Use of Hand-Held Calculators 



Three graphs charting the assessment results by aspects of 
calculator use » are displayed in Figures 5-12 through 5-14. For 
each objective and for each type of calculator use, the group of 
students who use hand-held calculators., out-perform the non-cal- 
culator group. This is true even for such non-computational obje- 
ctives as Knowledge, of Notation and Terminology (1.3), Comprehension 
of Measurement Qonc^pts Xl.T) and Comprehension of Geometric Cgpfcepts 
(2.3). , . - ^ 
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It seems logical to conclude that these dif f e*renc^s are caused 
by some confounding of the mathematics background variable with 
, the calculator group. However, similar results are obtained when 
'the calculator questions are analyzed for th^ Math 12 » 11 and 10 
groups separately. The different between the calculator and non- 
calculator groups are more pronounced among* the Math 10 group than 
among the Math 11 or the Math 12 groups, but they are in the same 
direction for all three groups on virtually eve ry^ objective. 

5*6.6 Time Spent on^Assignments 

The question concerning the amount of ^ out-of-clas| time>'stu- 
dents spent on mathematics assigni?ents was directed only to those 
students who were taking a mathematics course at the tin^ of the 
Matliematics Assessment. Of the 23 136 students «ho. wrote the test, 
11 522 or 49.8% indicated that they were not tak4.ng a mathematics 
course. A breakdown of • the data on time spent on assign^nt is 
shown in Table 5-23. 

Table 5-23 

Grade 12 Resuli^s: ^inie Spent on Assignments* per Day (Percent) 



Time Spent ^ ^ 


All Students 


' Math 12 


Math 11 


Math 10 ' 


None 


14.4 


6.8 


21.5 ^ 


40.3 , 


• Less than 30 Minutes ^ 


36.6 




32.6 . 


19.0 H 


More than 30 Minutes 


37.4 . 


47.6 


-25.1 


12.0 


No Response 


9.^ 


2.6 


18.6^ 


26.5 


Mult iple' B^ponse 


1.8 

0 


1.5 


' 2.2 - 


2.1 ' 



The "all' students" colum in Table 5-23 ^is not a linear combin- 
ation of the other three columns. The algorithm used 'to place 
students In the Math 10, 11, and 12 groups was based upon students* 
responses to two items, one dealing with courses presently being 
taken and the other with the last course successfully completed. 
Because of this, some students.could not be uniquely classified into 
^ one of the three mathematics background categories. 

» * 

The results of comparing amonnt of time spent on homework 
with achievement on the eleven assessment objective's ax^ summarized 

, in Table 5-24. As in^th^'eise of the calculator, c/ata, the diff- 
erences on any one objective are not usually very great. It is 

. the consistency of the trends which are evident in the Math 12. and 
Hath 11 groups which are of^most interest,/ 
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Table 5-24 ' 
Grade 12 Results by Time Spent on Homework , 
Number of Objectives on Which Homework Groups Attained Highest Score 







* 


Time ^ent 


on rfomew^o^k: ' ^ 




None 


Less than '30 Mln/Day 


^ More than 30 Min/Day 


All Students* 


0 


7 


5 . 


Math 12 


0 


11 


0 - > 


Math U 


0 


10 


1 ■ • . 


Math 10* 


0 


7 ^ 


.= 5 • , ■ 











* includes 1 tie 



As is shown in the table, the no-homework group never attaiijed 
the highest group score on an objective. In point of fact, this . 
group was always last and usually by a considerable margin. Among ^ 
the Math 11 and 12 groups, there is a definite trend foi?/the group 
th^t spends less than thirty minutes a day on mathematics assign- 
ments to achieve better results than either' of the other two groups, 

5,6,7 Parental Education Level 

"> 

NAEP found that parental education level was strongly , related 
to. student performaace. Students whose parents had rio secondary ^• 
school education scored between eight and thirteen percent below 
the national average, while those students who had at least one 
, parent who ha^ had some post-secondary education wer^ six to seven 
percent above the national mean. These results were Iparticularly - ^ 
apparent among the seventeen year olds exaMned by NAEP, the group 
closest in age to the BX, Gr^de IZ population, 

Th^ results displayed in Figures^ 5-15 ^nd_5-16 parallel the NAEP 
findings regarding the relationship^ befWe^n stucjCnt achievement . 
and parental educatWn level, ^ althoiiigh* th^ ^^^^ differences are ^ 
considerably smaller than those foiuid by N^^^^^^ 

The results show a'^pdisitive relatiorisKlp between student 
achievement and the /highest education -level achii^ed by both par- 
ents considered Irvdividually , It is ^nteresting^^o note that, in ^ 
both cases,* the lowest performance was'^record^d by those students' 
whose father or mother had completed junidV ^^cWdary school, > 
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5.6.8 Future Plans 



In Figure 5-17, the results of the assessment are reported In 
terms of students' future plans. For each Domain, the group plann- 
ing to attend university exceeded the provincial mean for that Do- 
main by the greatest amount: about 11% for Domain 1, 13% for Do- 
main 2, and 15% for Domain 3-. The poorest, performance on each Do- 
main was recorded by those students who indicated they would seek 
full-time employment upon completion of secondary school. 
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5 v7 Reporting Categories from the Reading Assessment ' 

In addition to the loatheijatics ^tesdu an assessmeut test in Readings 
was given at the Grade 12 level. These .Cest%.contaii»ed &imilar, and in ' 
some cases, identical background information questions. ' On both the - 
Mathematics and Reading tests, students were asked their bi^'thdate-,'* sex, 
and number of schools^ attended. Using common information, a computer 
search was able to match the complete reading and mathem^f^cs data for 
sixty^three percent of the Grade 12 students.'' A data.* file '^^s created 
to^ contain the information and .result^ 6n both .tests for th^' matched 
stud^^ 
could 



ontain the information and .result^ 6n both .tests for the matched 
M™f"so that comparisons between their performance on thWtwc?* tests 
doe made. — 



/ 



The new data^ file was used to obtain further information on stu-* ^ 
dent performance and to correlate certain aspects of student perfor- 
mance in mathematics witji student ^performance in. reading. In Se^ption ^ ^ 
5.6 of this report, theB^ta of the Mathematics Assessmen^t were organ- ' [ 

ized according to certain reporting categories sugh as age, sex, and J ^ 
use of hand-^eld* calculators. Ih^t^s section, the Mathematics ksse^e- 
ment data are^TTrganized by two reporting categories obta^ed from the 
Reading Assessment. 

• ' ' ' t 

Domain Two of the Reading Assessment jias Comprehension as it was ' 
in the Mathematics Assessment. Correlations were computed dn the 
Grade 12 Mathematics Assessment results for the /four objectives ^of the 
Comprehension Domain and the thr^e objectives of the Application 
Domain wit^ the Reading Assessment result^ for the two objectives* of 
their. Comprehension Domain. 

5.7.1 Reading ^Reporting Categories 

The two reporting categories from the Grade 12 Reading Ass- 
essment which are presented in this sectioi) concern langyage sp^aken 
and television watching, th^ee^ items shown in Figure 5-19' 

appeared on the Gradfe 12 .Rjeading test. 

, ^ 

1. Were you born in Canada? - ' 

Yes .... f . . . . . ........... / f 

1 " No .\ O 

2y* Did you usually speak a, language otlier than English before 
you started In Grade if 



Yes £7 

No ^ CJ 

3. Is English the language spoken In ^ur home? 

Yes ^ '.. CJ^ 

No ^ £7 



y 



- Figure 5-18: Place of Birth and Language Item^ from the 
Grade 12 Assessment 
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The results for the three items wer'e used to o;rganize J:he grade/year 
12 students into five groups. The groups were defined as follows: 

1. Non-Canadian, Non-English ~ All grade/year 12 students 
who responded "No" to item .I", "Yes" to item 2, and "No" 
to^tem S in Figure 5-18. 

2. Canacffan, Non-Engl^.sh — All grade/year 12 students who 
responded "Yes" to item 1, "Yes" to item 2, and'"No" 

to item 3. in Figure 5-18. 

3. First Generation Canadian ~ All grade/y^ar 12 students 
who responded "Yes" to item 1, "No" to item 2, and "No" 
XoMtei^ 3 in Figure 5-18. # 

4. Non-Canadian, English — All grade/year 12 students who 
responded "No" to item 1, "-W to item 2, arid "Yes" to 
item 3 in Figure 5-18. 

5. Canadian, English ~ All grade/year 12 students who res- 
ponded "Yes" to item 1, "No" to item 2, and "Yes" to 
item 3 in Figure 5-18/ 

I 

Once the data were organized into the five groups," the results' 
on each of the eleven objectives .for the Grade/year 12 Mathematics 
Assessment were computed. These are presented in Figure 5-19. 
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Figure 5-19: 



Grade 12 Results by Language Group 
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The Non-Canadian, Non-English' group obtained the higHest score 
on all three domains.. The First Generation 'Canadians group scored 

lowest on all three. As with Grade 8, • these resuMs indicate th^ 

students who come from a non-English-speaking background have an 
advantage, insofar as mathematics achievement is concerned. 

The item shown in Figure 5-20 also ^appeared on the Grade 12 

Reading Assessment test. , , * * 



About how many hours of television do you watch on an 
average day during the week? 

Usually none : n 

Less than 1 hour 

About 1 hour . . . ........^ ' a 

About 2 hours. . . o 

About 3 hours ^ n 

About 4 hours n 

5 hours or more 



Figure 5-20: Televisoh Watching Item from the Grade^2 
Reading Assessment 



The television-watching results were, organized into seven 
groups based on the s^en choices shown in the item in Fi*gure 

5t-"20. . The results are presented in Figure 5-21. 

> J 

The data presented in Figure 5/21 show a very distinct pattern 
with respect to Amount of television ^watched. Those grade 12 stu- 
den^-s who watched some television but averaged less than one hour 
per weekday obtained the highest scope on all three domains. The 
perfdrmace pattern is very consistent among the-GfaaesJ2 . students 
who watched some television: the iJcfre television watd^e'd, the . 
lower the performance levels. 

The Grade 12 performance with 'respect to amount of television 
watched is identical to the Grade' 8 one among students who watched 
some television. TJie group of Grade 12 students who responded that 
they. usually watched no television on a weekday performed at a 
level between the About 1 Hour and About 2 Hours groups, <- while the 
analogous group of Grade 8 students had a performance level between 
the About* 3 Hours and About 4 Hours groups. 
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The veiry consistent performac^ pattern with respect 'to amount 
of television v»atched exhibited inVboth the Grade 8 and 12 results 
is very different from the performance pattern exhibited in the 
results for the Grade/^ear four students as presented in Section 
^•6 of this report. 

5.7.3 Corlr^JLation of Reading Results with Mathematics Results 

Domain Two .of the Reading Assessment was entitled Comprehension' 
as was Domain Two of the_ Mathematics Assessment. Both tests were 
attempting to assess Comprehension .of' their respective content areas. 
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To see if there was a relatibnsTiip between scoires in reading and 
scores in mathematics, correlations were computed between the .four 
objectives of Domain Two of the Mathematics .A3sessment and the two 
objectives of Domain Two of the Reading Assessment. . . - • ^ 

— ---Since -a large maj-arityof^-the Items in the Applications Domain 
of the Mathematics Assessment required a great deal of reading 
compared to the otheir items on the test, correlations between the 
three objectives of Domain Three of the Mathematics Assessment and 
the two objectives of Domain Two of the Reading Assessment were' 
also computed. All Fourteen correlations are presented in Table 
5-25. - . 



Table 5 25 ' 

Grade/Year 12: Correlations of Readi^ig and Mathematics Results 



Read ing 
Objectives 


2.1 2.2 


Mathematics 
'2^ 3 2.4 


Objectives 
3^ 3.2 


3.3 •. 


2.1 


0.4^ 0.29 


0.35 


0.46 ■ 


0.44 


0.41 


\ 

0.33 


2.2 


0.37 (^^oqo 


0.30 


0.41 


0.40 


0*40 


0.i9 



The test to "cfetermine 2J a correlation is statistically signif- 
icantly different from zero is dependent upon the size of the sample 
Given a sample of size 14 57iv any correlation of 0.03 or greater 
would be statistically signifliiiant . Hence, it is more appropriate 
to talk of educational signi^ance. G/^ Glass and J. Stanley (1970) 
present the following categori^zations of carrelations: if the ^ 
correlation is less than, or equal .to, 0.2,' then it should be co^ij;^' 
sidered weak; if the correlation is betwe^n^ 0.2 and 0.6, then it 
should be considered of moderate strength; If .the correlation is 
greater than, or equal to, 0.8, then it-should'be considered strong. 

All of the correlations in Jable 5-25 ^re of moderate strength. 
Comprehension of algebraic concepts (Objective 2.4) had the highest 
correlation with both the reading objective^ and comprehension of 
measurement concepts (Objective 2.2) had the lowe^st Correlation with 
both the reading objectives. The correlations associated with 
objectives of Domain Three of the Mathematics Assessment averaged • 
about 0.02 higher tha^i those of Domain Two. 
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5 .'8 Summary Rp■rnmmpnf^a^^^.^e , 



Th&-<3rade 12 test consisted of seventy-rtwo items designed to assess 
!dd?Hn ^""'k''' °i Objectives grouped into three domains. S 

addition to the mathematics items, the test contained fifteen baclf ground 
information items which students were asked to complete before ta^ng 

LilS test • , _ / o 



riate .rp^f ^^.«P°"ded to all items on the test by shading in the approp- 
^ riate areas on mark-sense cards which had beerspecifically designed for 
the assessment. All items on the test were of the multiple-choide varLty 
For each item, five foils we^^e given. Of thle, four were possible 
answers toTxthe. item and the fifth was "l dor/t know". 

One'^d one-half hours were alloted foV administering the test- 
thirty minutes for instruc-t^bns, distribution and^lectfon of the 'test 
booklets and completion of the background inforlatioa items'; sixty 
minutes for completion of the test itself. T 

irt GrISe ^yf^ w^s designed to be written by all students enrolled 

Jo c^f ' ^'^l^^^ °f their mathematics backgrounds. According 

?rJp ?9 ' rio'^'^'^ Ministry of Education, the enrollment in ' ' 

?or 71 17 nf t ' ^"^r""^' ''''' ^2 532. Of this number, 23 136 
(qr 71.1^ of the total) wrote the test. , . 

5'8.1 Ra^kground Information ' ' ' ° 

, F 

.t^JTKT gathered from the fifteen bacf^ground inform- 

ation questions, over ninety percent dl the Grade 12 stjudents were 
Ibo^t'finr^"'^^^ or eighteen years old, the normal ages expected. 
About 800 i»,re females tha^ males wrote the test. While there were ' 

more !v.'^^^ "^V" ^"^'^^ group, there. weVe .over 1200 

more males^t^an females amohg the thirty-seV^n^cent 'of the total' 
population vho were takd^ng.or had taken sonLf^of Mathematics ^2. 
A temale ma#orityr occurred .among those students whose^ast mathe-' 
.•y matics courjpe was eithe?: Mathematics 10 or 11. 



As witli the Grades 4 and 8, the data on number of schools " ~ 

attended by students in Grade 12 reflecte'd the high degree of mob- 
ility ^ong the general population in B.C. By fhe time students ' . 
reached this -level they would normally have attended a minimum'of 
two schools, an elementary school and a Secondary school, or three 
schools, an elementary school, a junior secondary school, and. a 
- senior secondary school. The results.JLad4eafed that only about • 
forty percent of Grade 12 students had attended three or fewer / ■ 
schools since starting Grade 1. Unlike Grade 8 students," a mai- ^ 
ority of Grade 12 students responded that the school ehey were 
attending was semestered. r ' ' • <, • 

] t 

Three questions on the test concerned the use of hand-held cal- 
-r f^'^fy A mjority of Grade 12 students responded that' they used 

tork^^Jd r ".^^'r' '^"^ °^ "-^^ ^^^y^' ^t home, f5r home- 

work, and' in school • V 
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A majority of the students work at part-time jobs which emplpy 

them during the week as well as on weekends. Over one-third of thfe 
students plan to go to work full-time upon graduation. About one- 
third of the students plan "to' continue their education, ' f 

H * ^ ' 

5.8.2 Test Results 

» •» ^ 

The seventy-two items were organized into three domains: ^ • 
Knowledge and Computation (Domain 1, 30 items); Comprehension (Domain 2, » 
24 items); and Applications (Domain 3, 48 items). 

Students' performance on three items M Don^ain Dne wa§ rate;,d as ' 
a strength while no performahce .was rated tB[ a weakness. At least 
ninety percant of the students were able to reduce a fraction to 
its lowest terms and find the reciprocal of a fraction. The students' 
ability to recognize that zero is *tiot a , factor of twenty-two was 
rated as a strength in Objective .1, 3, Knowledge of Notation and Term- 
inology, 

Though there were no weaknesses, ^several performances were 
rated as being less than satisfactory. Multiplication and division 
of decimal' fractions,- and writing the decimal form of fractions and 
percents were areas in which the students' performances were rated 

, as marginally satisfactory. On the positive side, their performances 
in, subtraction with fractions and multiplication wit)\ fractions and 

. decimals Wfere rated as very satisfactory, * 




The results on two items from Domain 2 were rated as weaknesses v ^^-^ 
while none of the results in Domain 2 were rated as strengths. \\ j 

However, the performances on ten items fd(r Domain 2 were tated as 
very/satisfactory. The weaknesses o'ccurred on items dealing with 
^fry^ction concepts and the metric units of mass. The performances 
toat were rated as marginally satisfactory were on items cone 
ing ordering fractions, finding the arga of a' triangle, finding 
the slope^ of a line, simplifying an expression, and finding the 
amount of simple interest, ^ ^ 

The performances that were rated as very satisfactory were on 
item's conceriw.ng ordering of decimal fractions^, metric units of ' 
temperature, capacity, and length, equilateral triangles, fin4iU8 
the volume of a box, evaluating ^an expression, solving linear an"3\ 
simultaneous equations, and writing a mathematical equation for al 
word problem. h / ' 

The* Grade 12 students' performance on the/^^ghteen items of 
Domain 3 was n^t satisfactory. The results on /four items were 
rated as marginally satisfactory, and the results on five of the 
items were rated ds weaknesses. None of the results^ .were rrffed 
as strengths,^ and only four item results were considered very 
satisfactory. ^ . . * 

There were no weaknesses noted for Objective 3.1, "^olve Pro- 
blems Involving Operations with Whole Nbmbers, Fractions, Deciipals^, 
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and Percent, but^he r^sults on four items were rated as* marginally 
satisfactory, . * ' ^ ' 

The performances on four of the seven items for Objective 3*2, 
Solve Problems Involving (^ometry an4 Measurement, were noted as 
weaknesses • The items involved were concerned with finding the 
area of a squajre given its'perimeter, finding the ^^ea of a shaded 
pcyrtton of a rectangle, finding the surface area of a tube, and 
finding the length of the hypotenuse of a right .triangle given the 
lengths of the other two sides> On three of the four items, fewer ' 
than fifty percent of the students were able to obtain the correct 
answer. The other weakness noted for Domain 3 was with an item • 
•that involved finding -the principal amount given the rate of in- 
terest, the time, and the amount of interest. . ' 

There were some good performances on items frqm Domain 3. 
with over eighty-five percent of the students selecting the correct 
answer on items concerned with finding an average and finding the 
amount of a discountL 



5»8.3 Reporting Categories 
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Mathematics achievem^t is 3the end result of the coalescing of 
a great -number -of student^^based factors, ^oth- intrinsic and ex- 
trinsic. Attributes inherent in the student, programmatic and 
curricular variables, 4s well as the effect of enviroj|mental vari- 
ables >^uch as teacher differences » all contribute in varying and 
largely unknown degree to a given student's overall performance. 
Of the fairly large number oLsuch variables which the converitional 
wisdom, current educational practice, and the endeavors of ^educat- 
ional researchers havp identified as being related to mathematics 
ajfhievement, the ones selected for scrutiny in the Grade 12 Mathe- 
matics Asse^smdnt were mathematics background,' age, sex, number of 
schools attended, 'use of hand-held calculators, semes teVed versus 
non-semestered schools, time spent on homework, parental education 
level, and future plans; 



. ■ Mathematics Background — - Of the variables' selected, this is 
by far the most important. The results summarized in Section 5.8.2 
were for all Grade 12 students, but this group is madja of students 
•with very different mathematics backgrounds. ^ For this reason, the 
data 'were^gr<)uped into three categoijies: Mathematics 12, those 
students who had completed or were ^^ing some form of Mathematics 
12; Mathematics 11, those students v^jj^' were taking or whose last 
mathematics course .taken was some form of Mathematics 11; Mathe- 
matics 10, thos^ students who were taking or whose last mathematics 
course taken wa6 some, form of Mathematics; 10." 

The results for this variable produced the expected pattern 
of performance. Since the Math 12 group had chosen to takeV 
mathematics every -year they were itt school, it was not; stlrprl^ng- 
that 'they performed at a /much higher level, than the othep-two 
groups. Since the Math 10 group had decided not to tak/ any moi 
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mathematics than was required for graduation, it was not surprising 
that they performed at a' much lower level than the other two groups. 
Domain 1 is the only domain in which the Mathematics 10 group 
performed above the 50 percent level, and in this domain thej > 
performed at lower than the 50 percent lev6l on twelve of the 
thirty items. The Math 10 group averaged less than fifty perc^ent 
' correct 6n over half of the items on the test while the Math 12 
group averaged less than f if ty^ percent correct on only one item 
of the seventy-two . " ' ^ 

Age Differences — The general pattern was that performance 
decreased with an increase in age. Tne {Sattem held for every 
objective. 

Sex Differences — Males outperformed females on nine of the 
eleven-objectives. The two objectives where the females did obtain 
the higher performance were in Domain 1, the least complex ^ognitdve 
behaviour. 
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Jimber of Schools Attended — This variable appeared to be 
unrelated to mathematics achievement at the'^rade 12 level. 



Use of HanS-Held Calculators. — The data were organized 
according to the response on each of three items concerning the 
use of hand-held calculators at home, in school, and for homework T < 
In all three cases the results were the same: students who used 
hand-held calculators outperformed the students who did not use 
hand-held calculators on every objective. 

Tiihe Sjjent on Homework — Only the data on those Grade 12 stu- 
dents who were taking a mathematics coarse" at the time of the Mathe- 
matics Assessment J^ere analyzed for this variable. About two out 
of every thirty Mitth 12 students and two out of every five Math 10 
|f students responded tlM± 'they spent no out-of-class time on mathe- 
ma^tics assignments. The group of Grade IZj^students that spent no 
time at all on mathematics homework had the lowest performance on 
every objective. The differences were small but' the trend was very 
clear, Hath 12 students who spent some time, but less than thirty 
minutes per day, on mathematics homework had the highest performance 
>^ on every objective and the analogous group of Math 11 students had 
V the highest perf orrfance on ten of the eleven objectives, , 

Parental Education Level — The pattetn was cfear:' the more 
education e^ach parent had, the higher the performance.* An except- 
ion was noted in the. case of the group v^}®^ parents had completed 
jui3'ior secondary school. They p.erformed at ^ lower level than 
thy group whose parents had completed only elementary school, 

, 0 Future Plans — Students planning to attend university .per- 
formed at the highest level on all objectives. Students planning 
to look for jobs performed at the lowest ^JLevel on ten of the' eleven 

**^objectives, . ^ ^ 

• » , — V * - , 
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5.8.4 . Data fro^ the Reading Assessment . 
* \ • , 

'In addition to the Mathematics test, an assessment test in Read- 
ing was also given at the Grade 12 level. These two tests cotitained 
similar, and in some cases identical, background information questions 
On both the Mathematics and Reading tests, students were asked their ^ 
birthdate, sex, and- number of schools attended. Using the coupon ^ 
information, a computer .search was able to match the complete reading 
and mathematics data for sixty-three percept of the Gp&ds^lZ " 
students, A data file was created to contain the information ^ and 
results on both tests f;6r the matched students so that comparisons 
between their perfja^naffeces on the tests could be made. The .two 
reporting categories from the Grade 12 Reading Assessment which 

were presented concerned language and television watching. 

f 

Language — The Grades 12 data were grouped according to whether 
the students had beeg borti in Canada, whether they usually spoke ^ 
language other than English before starting Grade 1, and whether 
English was the language usually spoken in the home. The non-Cana- 
dian non-English-speaJcing group obtained the highest results in " 
each domain^ ' ^ 

Teie^ision Watching Grade 12 students who watched som^ 
less 'than one hour of television, per weekday had the best perfor- 
mance on every^bbjective. The pattern among the data was that the ^ 
more television watched, the lower the performance on the Mathe- • * 
matics Assessment test. The no television group ranked 'between . 
the about one hour and about two hours groups. 

5^,8,5 ' Recommendations ^ 

Based 6n the data presented in this chapter, the following 
recommendat/idhs were made. 

Reoormendation 5-1:^ The Ministry of Education slhuld institute. a 
program of research designed to ascertain why such a high proportion * 
of female students do not continue to study mathematics beyari4 the 
last compulsory course. ^ 

Recommendation ^ 5-2 : On the basis of the evidence obtained as a 
result of .the implementation c^f Recommendation 1^ the Ministry of ^ 
Education^ in cooperation with local school districts and teachers^ 
groups^ should^ institute professional development programs to > , 
sensitize teachers and counsellor^ to this tendency and with ways 
of dealing with it, ^ 

Recommendation '5-3 : The Curriculum Development Branch should 
consider the impact of the use of hand-held calculators in mathe- 
matiMis classrooms at various levels: primary; intermediate; 
junior secondary; and senior secondary.. ^ The Committee should - ^ 
provide guidance and direction to^.teAchers of' mathematics 
regarding the most appropHate uses of such calculators in their 
teaching. y ' 



Recorrmendation 5-4: Schools and sj^fiool districts should implement 
progrpms 'tg familiarize all of. their students ^ hut especially those 
at the senior secondary levels with the basic 'concepts and prin- 
ciples ojythe metric system of measurement. 

Recommendation 5- 5: The Curriculum Developrfient Branch should examine 
the situation with regard to the teaching of percent and its appVi- - 
cationSj and give specific suggestions to teachera regarding appro- 
priate materials and methods to be used in teaching these topics. 

Recommendation 5-6': Teachers and teacher educators should stress 
the overriding importance df problem solving in mathefnatics and^- 
they should attempt to teach their students various strategics to 
employ in attempting to solve problems in mathemdtics^ ' 

*Reoomnen^tion 5-7: Individual teachers^ and mathematics depart- 
ments should set up their own collections of problems and activities 
out of which problems groWj keeping in mind the interests of their 
students and making use of local information in-order that their 
p'roblems will be more interesting to students. . ^ ' 

Recorrmendation 5-8: The Currioulvm yevelopment Branch should give 
immediate and serious confederation to way^ ar(d mearts of ensuring 
that all students completing Grade iB have been taught the major 
topics of .consumer mathematics. ^ . \^ 

Recommendation 5-9 : The CurriculKm Development Branch should recon- 
sider the , nature and scope of the geometry curriculum at the secon- 
dary school levely keeping in minoKthe results obtained by the 
"students on" the geometry items on tm^s test. 
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Many^f the skills and concepts of mathematics which are laiSrned in 
one grade continue to be useful- and important in subsequent years. More- 
over, it is often the case that when such toncept^ of skills are intro- 
duced for tlve first time, ^ mastery is not expected. Instead, since teachers 
and curriculum developers know that; the topic will be re-introxluced plater, 
only certain aspects are dealt wi£h each time and only a certain degree of ^ 
mastery is expected/ In other Words | since mathematics is developmental 
and highly sequential^J.a/Tiature , a degree of development in students' 
ability to deal wifh various concepts and skills is not only to be expected 
but desired. * ^ - 
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In order to, obtain information about development of students' mastery 
of such topics, a number of items were repeated on two or, in some cases, all 
three of the tests. Nine ite^ w^re repeated on Gr^e 4 and 8 tests, forty- 
three items on the Grade 8 and 12 tests. Of the irxems that appeared on more 
^than one t'est/ five appeared on all three, Figi/re 6-1 presents the distri- 
*))ution of the common test items as the items are numbered on the Grade 8 test. 




(Th'e items are nurobered 
as they appear on the 
Grade 8 test^). 



■J 



Figure 6-1: Distribution of Conmion Test Items 
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S It;ems Common to All Three Tests 

The five items appearing on all' three tests measured students' 
knowledge and understanding of the units of the metric system of measure- 
ment,. Results for these fiye items appear in Table 6-1 , 



Table 6-1 ^ 
ResultSfOn Items Common To All Three Tests 



Item No. 


Topic 


— ^ ^ — 

Grade/Year 4 


Girade & 


Grade 12 


19* 


* temperature 


32 


er 


87 


20 


conversioit 




69 


63 


21 


capacity 


• 67 


84 


90 


22 


mass 


25 


45 


5'4 


23 


length 


81 


84 


82. 


Average 




50^8 


70.2 


75r2-\^ 











* Items are numbered as they appear ork Grade 8 Test 

According to the Curriculum flGuide fo^ Mathematics, students in 
Grade/Year 4 should have been tMight the metric systen^ of measurement -ar^^u 
^only the b[ietric system since they entered school. In spite of this only 
32% of the Grade/Year 4 students chose the appropriate temperature for a 
sun'ny summer day and only 25% wer^able to select the appropriate mass for 
a ten-year-old boy. One cause for the much better performance at the' 
higher grade levels may be the exposure the public has been receiving 
concerning fc^he me^tric u^its through the cpmmunications media. Item 19, . 
below, is a ROod example, • ^ 

19, The tempeWature on a sunny summer 



day would/ most likely be 




■ Grade /Year 4 


Grade 8 Grade 12* 


• . A) 5 Celsius . 
B) 25 Celsius 




5. 
32' 


" 5- • 
69 


3 
87 


C) 55 Celsius'' 

D) 85 Celsius 




27 

. '29 


12 * 
.9 


5 
3 


E) I don't -know 
No Response 




' -6 

* 1 \ 


• 4 
1 


2 
1 


Figure 


6-2: 


Common Item (degrees Celsius) 












• 








* 
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Canada has been using degrees Celsius for tem^rature for over two 
years, a longer period than for any of the other new units. While^ the 
degree Celsiugis the unit that shoulid- be most familiar to the Canadian * 
people, Item '^^>ielded the most drastic differences among the three 
groups of all five items which dealt with metric measurement. It may be 
that Grade 8 aAd 1?" students are m6re knowledgeable about tetnperrature in 
degrees Celsius simply because they are more aware of the day-to-da^ temp- 
eratures which are reported in these terms. 

All three groups performed equally well' on. Item 2i3, sh6wn in prgufe 
6-3 ^hich de^lt with units of length in metric systejji. 

23. About how long is this crayon? ^ 




A) 1 centimetre 

B) 10 centimetres 



C) 1 metre 

D) 10 metres 

E) I don' t know 
No Response 




Grade /Yea» 4 
81 



5 
5 

A 
1 



Grade 8 
2 
84 



6 
4 

^3 
1 



Grade 
3 
82 



\2 



4 
4 

7 
1 



Figure 6-3: Common Iteiri (length) 



The cenximetre is one of the first metflc units introduced in the 
primary grades, and all of the mathematics textbooks used in the primary 
grades suggest experiences analogous to that in Item 23. AIL three Inter- 
pretation Panels were satisfied with the students' performance on Item 23. 
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Items Common to the Grade 4 and 8 Tests 



Four items, Items 4, 10, 16 and 32, were used on both the Grade 4 
and 8 tests. The results obtained by the two groups on these items are 
summarized in Table 6-2. 



Table 6-2 



\ Rl^sults on Item^ in Common 'to the Grade 4 and S Tests 







»S ®r 




Item No. 


^ 

Topic 


Grade /Year 4 ' 


Grade 8 


4 ' 


addition 


89 


93 


10 


piace value 


88 / 


90 


16 


subtraction 


56 i ' 


89 


32-. 


addition (money) 


80 \ 


88 


Average 




78.2 


9b: 0 
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Three of the four items, atl but It^ 10, were p-fesented as open- 
enc}ed exercises on the Grade/Year A test , "whereas aid of the items on the 
Grade 8 test were' multiple-choice . Because of*this/ any comparison be- 
tween the results' of the two groups of students shotld be made with 
caution since the format of the items may have influenced student perfor- 
mance. Comparison, hpwever, is made easier t>y the fact that on Items 4 
and 32 both'groups performed very well. 

The Interpretation Panels for both grades^ere' pleased with the 
performaces on Items 4, 10 and 32, and the Grade 8 Panel was very satis- 
fied with the Grade 8 students' performance on Item 16, The results on 
Item 36 of the Grade/Year 4 test, the same item as Item 16 on the Grade 8 
test, were judged to be a weakness by the Panel for that grade, A complete 
discussion of the resOlts on that item may be fc»ind in Section 3,3*3. 

6.3 Items Common to the Grade 8 and 12 Tests , * 

Forty-three of the iteig§-3i»^*H^e Grade 8 test, including the five 
^metric items .discussed in Section 6.1, also appeared on the Grade 12 test. 
The results obtained on these items are discussed in this section which, is 
organized according to the Grade 8 list of objectives. For feach objective 
the following information is provided: ' 

1) the i,tem numbers for thS" common items from the Grade '8 and 12 tests 

2) the item results for four groups -of students. Math 8, Math -10, Math 11 
and .Math 12 ^ j 

3) the average percent correct for the co^mmon items on that objective, and 

4) the number of items used to assess that objective. 

Items which were common to these two tests/liad been given ir'^entical 
item numbers so that comparison betweeq t^sts /would be facilitated. 

All students, who took the Gi^^cl^ 12 test were enrolled in Grade 12, 
but not all of them were taking Math 12. For that reason, the Grade 12 
results presented in this section are organized by three groups of students 
those students who had completed or were taking some^ f orm of Math 12 (Math 
12), those students who yere taking or whose highest mathematics course 
completed was some form of Math 11 (Math 11), and those students who were 
taking or whose highest mathematics course completed was some form 'of Math 
10 (Math 10). The fourth group of students discussed in this section in7 ei 
eluded everyone who took the Grade 8 test' (Math 8)-. 

The number of items used to assess an objective is, given since the 
following three situations arise: 1) the common item^ and the items used 
to assess an objective are i dent icral, 2) , the same number of- items are. used 
on each test to assess an objective and tfie commpn items are a proper sub- 
set. As a result, the average on a set of common items for an objective " 
may differ from the average "for the objective reported in Chapter 4 or 5 
because it- is based on a different set of data. ^Decisions or judgments 
regarding the degree of success attained by a group of students on a given 
obje.ctive should be based^pon their performan(f& on the complete set of 
items used to assess that objective and n<3t 'on a subs*et of them. The ^dis- 
cussion in this chapter will therefore focus on a comparison of groups' 
performance relative to each other and not onV^ny single group's perfonn^ 
ance on an objective. 
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None of the items used to evaluate the 'objective , 'Computation with 
Whole Numbers, on the Grade- 8 test were repewte^^iggn the Grade 12 test. 
For that reason, presentation of the results of the^teros' common to the 
Grade 8. and 12 tests begins with Computation wrfh Fractions. 

6.3.1 Objective: Confutation with Fractions ^ » 

The four items used to assess this objective on the Grade 8 
test were also used'' on the Grade 12 test* The ^results for these 
items are^presented in Table 6-3. 

Table &-3,r 

Results for Itcrite Common to the Grade 8 and 12 Test ^ 
Objective*: Computation with Fractions 



Item 



Operation 

-4^ 



Math' 8 



Percent Correct: 
"Math 10 Math 11 Math 12 



2 
6 
11 

29 . 
Ave rage 



Addition 
Subtraction 
Division 
Multiplication 



66 
63 
62 
82 

68. 2 



67 
67 
47 
74- 

63.8 



84 , 


98 


84 ■ 


96 


70 


91. . 


. 85 


■ 96 


80.8 


95.2 



The objective was assessed by four items on* each test 

It is r\ot surprising that the Math 11 alid Math 12 groups scored 
significantly .higher than the Math 8- and Math-40 groups on this or 
any other set of items, since the students in Math 11 and Math 12 ^ 
are, generally speaking, the most capable and most interested mathe-^ 
matics students. As might well be expected on this objective, which 
is froift the lowest 'cognitive behaviour, the Majth 12 performance was 
very high. - ^ ' , \ ^ 

Those Grade 12 .s]tudents whos^last mathematics course was some 
form of Math 10 had a lower average perfo^rmance than the Grade 8 
students on this objective. The Math 10 group out-performed 'fhe Math' 
8 group on addition , and subtraction items, but th^ Math S^^s ^superioi 
' on* the multiplication and division items.* 



6.3.2 Objective; Computation with Decimals 



The same five i^ems,were Used to assess ttiis objective on both 
the Grade 8^and 12 tests^ The .students' performance 'on' these items- 
t^is summarized in Table ^6-4. * . " \> 

The general pattefh of performance ^eems to be the same for ^ 
computation with 'fractions. It: is interesting to note 'that the per- 
formance ^of the Math 10 gfoup is the onJLy one that' is higher on this, 
objective ^han on the previous one. The M#rti 8 group still outperfor- 
J med the Math 10*grou{), however, and tlie Math 12 group performed ^above 
the 90% level. Compared to the performan'ce 'on ^computi^tion with frac-^ 
tions, the Math 8 and Math 10 groups ^erfiprmed ^t a lave 1* which was 
closer ^o, but still distant from^'^toe Math 11 grppp. 
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Table 6-4 

Results '^for Items Common to the Grade 8 ahd 1^ 
Objective*: Computation with Decimals 



Tests 




X t&m 


Ope rat ion 


riHcn 0 

^ 


Percent 
Math 10 


Math 11 


Math 12 


1 


Subtraction 


79 


78 


85' " 


93" . 


5 . 


Multiplication 


63 


, '57 ■ 


74 


92 


• 15 ' 


Addition ' . 


72 


. 75 


83 


90 


17 


Subtraction, 


66 


71 


84 


95 


28 


Division 


56 


hh 


60. '■ 


, 82 , 


Ave rage J 




67.6 


■ 65.0 


'11.2 


90.4 



* The objective was assessed by five items on each test. 

AH three groups at the Grade 12 level seemed not to be affected 
by the '^ragged alignmfent" factor in Item 17. The difference in per- 
formance' between Item 1 and Item 17, both .involving subtraction of 
decimals in horizontal form, was seven percent for Math ^10, one percent 
for Math 11,- and a tWo percent increase for Math ,12. The Math 8 per- 
formance dropped thirteen percent between the two Items. " ' 

6.3.3^ Objective ^ .Knowledge of Notation and Terminology 



JFoUtxeen items were used to assess students' knowledge of nota- 
tion and temtLnology on *the Grade 12 test, and nine were used on the 
Grade test. Of these, eight items were common to Uoth tests/ The 
i;esults obtained on the common items are displayed in Table 6-5. 
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. V Table 6-5 ^ - 

' Pfesults for* Items -Coijraion to the Grade 8 and 12 Tests 
Objective*: Knqw.ledge of Notation and Terminology 

*) ; * ' • ' Percent Co'rrect: 



Item 


/' Topic ' 




Math 8 


Math 


10 


^. • Math 


11 , 


Math 12 


3 


-T^- 

Square Root 




51 


" 62 




' 87 


'V - .- 


' 99 . , 




Factqr^ 




78 , 


. '71 




. 83 


96 • - 


^2(^^ 

30(1 


Powers of 10 
Centimetres 
fExpqnents 




., 73" " 
69- 
' 72 


■ . 56 
. 38 
' . • 67 




71 
55 
88 




87 \ 
- 85 ■ • 
\ 96, , 

87 


-34 


' G.C. Fi^ ' ' * ' 




73 * 


- ^ 66 




75 






Keciprocal. " 




>80 • 


74 




, 89 


f 


98' 


" A5 


Prime, Numbers 




•^.53 


38 




60 




84 

91". 5, 


*Average 


i t:' • 




68.6. 


..59- 


■0, 


76. 


P 



*Tiie* objective v4s assessed by nine items oA Grade 8 t6st and fourteen items 
'on/the .Gra'afe -12 test.. *' 1 h^^^^ ' ^ *' 



All three* Grade 12 groups recorded their lowest performance of 
the eight items onr Item 45, identifying a prime number, .The Math 8 
group's performance on Item 3 was the only one of the eight items on 
which they performed lower than Item 45. The Math 10 group performed 
equally poorly on Jtem 20, converting 5 metres to centimetres. The 
Math 8 performance on Item 20 was secjind only to that of the Math 12 
groups* .y/ 

Onc^ again the Math 8 group's performance was higher than that^ 
of the Math 10 group, and the Math 12 group continued to perform 
above the ninety perceat level. « ' 

6.3.4. Other Common Items from Domain One ^ . * ♦ ♦ 

Because the tests ^ere designed Jfor use at .three different grade^ 
levels, some items which were r.epeated werfe classified with different 
objectives on different tests. There were, seven such items. Three of 
the items used to assess Knowledge 'of Geometric Facts on the Grade 8 
test were used to assess Knowledge of Notation and Terminology on the 
Grade 12 test. The results for those three items are foond in Table 6-6. 
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Table 6-6 ; ♦ 

Results for Itema Cpmraon to the Grade 8 an(l 12 Tests 
Objective (Grade 8): Knowledge of' Geometric Facts 
Objective (Grade 12): ^Knowledge , of Notation and. Terminology 



— f — •— _ 


Ite^m • 


( 

^ Topic ' 


Math 8 ' 


Percent 
. Math 10 . 


Correct : 
, Matb ir 


. Math' 12 


42 


Obtuse^^gle 
Diameter 
Sphere ' 


■ 40 
72 


35 
66 

80 ' - 


51 
77 
87 


88 
86 

95 , 


Average : 




58. 3 , 


60.3 ' 


71.7 


89.7' 



The Math 12 group's perforjnance is slightly below the ninety per- 
cent-level, but the performance is still high, as would be expected. 
The Math 10 group o.utperformed the Math 8 group on these three items 
on the average. ' 

All three lower groups h&d difficulty with Item 39, recognizing 
an obtuse angle. Whether or not the classifying of • angles as acu^:e, 
right, and oljtuse is taught dr'i's perceived ks being importan^t by 
students and teachers cannot be determined from the data.- . ' 

Four of the items used to assess Equivalent Forins pt Rational 
Numbers on the Grade 8 test were used for Knowledge of Other Algorithms 
on the Grade 12 test'. The results for the four items are presented in 
Table 6-7. ' 
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Table 6-7- 

Res'ults for Iteins Common to 'the Grade 8 and 12 Tests 
Objective (Grade 8): Equivalent Forms of Rational Numbers 
Objective (Cr£de 12): Knowledge 6f Other Algorithms 





Item Topic 
« •' 


Math 


Percept Correct : 
8 Math 10 


Math 11 


1 

Math 12 




- -13 fr^act-ion to Percent 


" 55 




56 


■ 75 


94 ' 




31 Fraction Co Decimal 


38 




42 • ; 


61 


87 




, 35 Percent to Decimal * 


A7 




39 


. 57 ' 


■86- • 




A6 Reducing Fraction 


80 




84 


91 


97 


• 


Average : 


' * 55. 


0 


55.2 




91.0 



eric; 



The results of these last fojjr items of Domain 1 tha*t are common 
* to the Grade 8 an5 12 tests follow the same basic pattern as for the 
other objectives • The Math 12 groupT perConned at above the ninety* 
percent leyel, Math- 8 and Math 10 performed at similar levels, and 
Math 11 performed at. a, level between^the Math 12 performance level 
and that of the Math 8 and Math 10 groups. 

Reaormendation e-l: Seoondary mathematics teachers should work to 
improve the Math^Sy Math 10^ and Math 11 students' performance on the - 
us^ of algorithms for rational numbers: the four basic operation's 
with fractions^ the four baste operations with decimals^ and equiva- 
lent foihns of rational numbers. 

Figure '6-4 presents graphically what has been stated in the dis- 
cussion: the Math 12 group's performance was above the ninety p^cent 
^ev^l, far superior to the ot^her groups; the Math 11 group's perf6r- 
mance was abound the seventy-five percent level, well above" the 
performance of the lower two groups. The Math 8 and 10 groups' . 
ormances .were very similar and low. . imu 
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Figure 6-4; Grade ^8 ertd 12' Results of Common Items, Domain 1_ 



6.3.5 Objective: Comprehension of Number Concepts 

On both the Grade ^and 12 tests sixHtems were used to assess 
Comprehension of Niimber Concepts. Of the six items, five were common 
to both, tests. The\e^ults for the five items are presented in Table 
6-8 ^ - 

^Table 6-8 . 



173 





Results, for Items Common to 


the Grade 8 


and 12 Tests 






Objective*: Comprehension of Number 


Concepts 






I 








— ~ . 




Percent Correct: 






Item " 


Math 8 


Math 10 


Math 11 
* 


Math 12 


12 


42 


\ 44 


55 


78 


14 


69 


78 


83 


94 


18 


32 


35 


45 


66 


47 


^ 29 


37 ■ 


51 


79 


50 


59. 


60 


■ 71 


< 67 


Ave rage : 


46.2 ■ 


50.8 . 


61.0 


80.8 



* The objective was assessed by six items on each test. 

As has been noted in the three prece^ding chapters,, performance 
levels tend to decrease as the c^linitive behaviour (domain) level in- , - 

creases. This tendency is also trOe ^ong the three subgroups at the ^ 
Grade 12 level, ^as is evident from the results shown in Table 6-8. 

The pat,tems of performance for each group relative to the ^her 
three remain the same as they were for the objectives pf Domain 1,'with. 
the Math 12 performance being far ^ugerior to the others. The Math 8 
and Math 10 groups continued to perform about equally well. Students 
from all four groups had more difficulty with Item 18 than with any . - 
of the other items in this group. Item 18 and a discussion of the * . . ' 
results are presented in Section A.A.I fog: Grade 8 and Section 5.h.\^ 
for Grade 12. Only the Math 12 group obtained a result higher than 
fifty percent 'on this item, and their score*' was twelve percent le^sr- 
on this item than their ^next lowest score. . . ' 

6.3.6 Objective: Comprehension of Measurerment Concepts 

^ The five* 'items used to assess mastery of measuremerit concepts on 

^ the Grade 8 test were also used to assess the same- objective on the 
Grade 12 test. The results for these five items are presented .i^ 
Table 6-9. ' ^ 

Items 19, 21, 22, and 23 also appeared^on the Grade/Year 4 test " \^ 

and were discussed in section 6.1 of this chapter. ' The paf:tem 6f 
overall performance portrayed here^ is 'basi-cjal^^ th6 same. The Math 10 
groop^ outperformed the Matji^ group HV 'eleven percent on Item 19, the 
metric ^temperature it-em, but it is not ^s^ible to tell f rom ^the data ^ 
* ' ^whether that superior performance was due to school-based'*f actors or 
_^t.o the exposure to the new ynit^ of measuremenj: for temperature on a - 
-^^W^ay-to-day basis.' <4 *^ ^ - 
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/ Table 6-9 

Results' for Items Common to the Grade 8 and 12 Tests 
Objective*: Compreliension of Measurement Concepts 



Items 





19 
' 21 

22 

23 

43 

Average 



Percent Correct 



Math 


8 


Math 10 


Math 11 


Math 12 


69' 




> 80 ■ • 


86 


92 


84 




82 


89 


96 


45 




40. 


49, 


67 


84 




' 65 


79 


93 


65 




63 


78 


.94 


69. 


4 


66.0 


76.2 


88.4 



^* The objective^as assessed by five items on efach test. 

The centimetre, on the other h^d, is one of the firawt metric 
units introduced in schools and is ^sed orJ^ in a very limited way 
in today's society. The Math 8 giyup oa^^r formed the Math 10 group 
and the Math 11 group^on Item' 23, the loexxic length item. 

Eeoommndation 6-2 : Teachers of mathematics ^ curripultan developers^ and ' 
teacher educators should cooperate in starting both pre-service and in- 
service efforts to en8^b*e thcCt all students ^receive proper instruction in 
all the facets of thk mati^^e/system of measurement meeddd to be a func- 
tioning member of Canadian society. 

\ 



6 • 3 . 7 Objective; Comprehension of Geometric Concepts - 

The Grade 8 and 12 tests each^ included four items Co assess Comp- 
" rehension of <3eoiaetric Concepts. Two of the four items were common to 
both tests, aijd the results for these two items are presented in Table 
6-10. 

Table 6-10 * T ^ 

Results for Items Common to the . Grade 8 and 12 Tests ' ^ 

Objective*:. Comprehen-lion of Geometric Concepts 



Items 



^ Percent Correct : 

Math 8 Math 10 Math 11 



Math 12 



52^ 




24 


24 


^ 42 


83 


54 




63 


66 


,78 


92 - . 


Averag^: 


4 




- • 45.0 


60.0 

— — « c 


87.5 



*Tbe object;lve . was a^s^ssed by four Items on each test. 
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One of the most startling results was produced on Item 52; find- 
ing the .area of a right triangle. Item 52 and a discussipn of the 
results are presented' in. Section 4. 4'. 3 for Grade 8 and Section 5.4.3 
for Grade 12. This item involved the use of the formuLa for the area 
of a triangle, one of the most simple and useful geomeyric formulas. 
On Item 54, which required students to find the volume of a box measur- 
ifig 6x5x8, the Math 10 group outperformed the Math 8 group by only three 
percent. - ' . 
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RecormendaHon 6^3 : Curriculum developers and secondary mathematics 
teachers should ensure that the basic, formulas for area and volume are 
presented and understood by all students. 



6.3.8 Objective : 



mpijehension of Algebraic Concepts 



Nin^ algebraic concept items were included on the Grade 12 test 
and three on the Grade 8 test. Two items were common to both fests, 
and these are discussed in Table 6-11. 

Table 6-11 

Results for Items Common to the Drade 8 and 12 Tests ^ 
Objective*: Compreliension of Algebraic Concepts ^ ^ 



Items 



-L- 



Percent Correct ; 
Math "8 Math 10- 



Math ,r 



Math 12 



48 
57 

Average 



18 
68 

43.0 



32 
70 

51.0 



58 
82 

70.0 



92 
68 

90.0 



This objective was .assessed. by three items on the. Grade 8 test and seven 
items on the Grade ^2 test. ' / 

The performance on this objective' is close to what might have 
been expected. The Math & group scored low, but they had only be^bn 
to use algebraic, concepts an , the more formal mathematical sense. The 
Math 10 group scores were low, but higher than those of the Math, 8 
group. The Math 11 group scored nineteen percent higher than Math 10 
and twenty percent lower than Math 12. Item 48, which dealt with 
, order of operations, yielded a much lower perfoiarrSice than was antici- 
pated. The results for Item 48 obtained by th^^J4^th ^ group are dis- 
cussed in Section 4.4.4 of this A^'eport and the results of Item 48 for 
, the 'Grade |.2 group are discussj^ in ,Sectiou 5.4."^. 

1 ■ » ^ 

'The pattern of perf ormajn<*e for the four groups on the common 

^ items of Domain 2 are presented "la Figure 6-5.. 
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. V^ert comparing the performance of a group with respect to the 
other three groups, the result^ are analogous to those presented for 
_the cokmion items of .Domain 1. The Math 12 group's performance was 
an average / of twenty percent greater than the Math 11 groupis which, 
in turn, was an average of thirteen percent gyeater than the lower 
two grbups. The Math 8 and 10 groups' perrormances we^re JLoxai^and had 
an*- average dif ference of less tl^i^one percent. 



* » 



176 



ERIC 



100-1 



so - 



ao - 



TO - 



00 - 



PERCEHl so - 



If 



"1 



V 



I 



f 



D8JEC1IVE 2.1 



OBJECliVE 2.2 OBJECTIVE 2.3 
* 



OaJECTIVE 2.4 



Figure ,6-5 ;i Grade 8 and 12, Results of Conmon Items - Domaiir2 

6.^^9 Objective: Solve Problems Involving Dlff^ent -Sets of Numbers 

a'^^^ ^^^^^ ^'^^"^ "^^^ ^° assess t^his objective on the Grade 8 
testi^ree Items were^-repeated »on the Grade 12 test where nine Items 
wer^sed to assess the objective. The results for the three Items 
in common to both tests are presented In Table 6-12. On this objective ' 
the results were similar to those for Comprehension of Algebraic Con- ' 
cepts in that the performance level Increased for each succeeding group. 

Table 6-12 % 
.Results for Items Common to the Grade' 8 and J2 Tests 
Objective*: Solve Problems Involving Different Sets of Numbers 



Item 




PSrcent Correct 



7 



58 
•59 

60, 
Average': 



} . 



items on the Grade 12 tes^ 



Math 8 


Math 10 


' Math 11 


Math 12 


68 


75 


85 


95 


57 


63 


75- 


91 




41 


58 


86 


53. 7 


/ -59.7 


72.7 


90. 7 


y seve^ 


Items on the 


Grade 8 test 


and nine 
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The item that yielded, the lowest performance, Item 60, was "^a 
multi-step problem. The item and a disc.ussion of the results appear V 
in Sections 4.5.1 '(Grade 8) and 5.5.1 (Grade 12) of this report. It ^ 
seems likely that students *who\ did the problem incorrectly did so 
because they tried to turn it 'Into a one-step problem. On both 
tests the students selecting an incorrect distractor were evenly split 
between distractors B and D. Both. of these distractore are based on 
/Students combining nwp percents and using the results as the number of 
students. y ' ^ 

6.3.10 Objective; Solving Problems Involving Geometry and Measurlment 

There wereCtfTree items on the Grade 8 test and seven items on the 
Grade 12 test used to assess students' ability to solve geometry and 
measurement problems from the Applications Domain of the* Mathematics 
Assessment. Two of the items were used on both tests. The results 
for those two items are presente'd in Table 6-13. 

. ' Table 6-13 ' • ^ 

Results for Items ^Common to the Grade 8 and 12^ Tests 
Objective*; Solve Problems Involving Geometry and Measurement ^ 
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Percent Correct; 






Item 




>feth 8 Math 10 - 


Math 11 


Math 12 


v: 




66 61 

27 ^ 27 ^ ^ 


^ 78 
44 


94 

^ 79 


Average: 




46.5 M.O 


61.0 


86.5 

/ 


*This objective was 


assessed^by three items on the Grade 8. test 


and seven 



iteiHS on the Grade /12 test. • 

A more common^ performance pattern prevails for the two common 
items from this objective. Math 8 and Math 10 performed at similar 
levels. Math 11 between the two other Grade 12 groups, and Math 12 
some twenty-five percent higher than the next highest group. 

Item 37 obvious^ caused considerable difficulty for everyone. 
The item land a discus^on of th^ results for the item may be found 
'in Sections 4.5.2. 

^ The performanc? pat^tem for the four groups on' the common items 

of Domain 3 are presentec^jm vFigure 6-6. The' same pattern exists 
for the common items of Domajh 3 as did for Domains 1 and 2. 'The 
Math 12 group performed an average of twet^y-two percent higher than 
the Math 11 group which performed fifteen percent better than the 
lower two groups. The Math 8 and 10 groups' performances differed 
by jLe^s than two percent. 
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f^igiire 6-:6: Gfade-8 3nd^l2' Results of Common Items - Domain 3 



6» 4 Summary and Recommendations 

One of the aims of the Mathematics Assessment was to gather data which- 
would give some insight into the development ol students' aMlities to deal 
with certain concepts and skills, • To gather data relevant to this aim, a 
number of the same items a.ppeared on two or more of the tests, - - 

. ' r 

Five items were common to all three tests. *These were concerned with 
knowledge and understanding of the uni^s of the roe^tric system of measure- 
ment. The Grade 8 and 12 groups consistently scorecf higher than the Grade/ 
Year 4 group. On the metric length items the three grade levels were separ- 
ated by only three percentage points, 

'A ' • ' 

There we^Kour items that appeared on the Grade 4 and 8 tests, but 
not the Grade j^ktest. On three of t;he four item^s both groups scored at 
the eighty pet^^F level or higher. On Item 16 the Grade 8-grdup scov€^ 
one third higher than the Grade/Year 4 group but Item 16 was open-encfe^^ 
on the latter test and multiple-choice on the former, which may account 
for some of the difference in performance. 
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There were forty-thre^items common to the Grade <& and 12 tests Due 
to the large number, the' remits for -the items were organized^ aijd discussed 
by objective* - / 
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The Grade 12 group was divided into three ^ubgroups: JJ*^ 12, students 
who are taking or h^ave conq>leted ^me form of Mathematics 12? Math 11, 
those students taking or whose highest mathematics course completed is « 
some f^cvx of Mathematics 11;. and Math 10, those V^tuclents taK^nfe or-whctee 
highes^B^thematics course completed is some form of Mathematics^ 10 / The 
Math 8 g^P^^ int: laded everyone who too^ the Grade 8 test, — ~ 

The^ean performance^of each^of the four groups for th^ items common 
to tlie Grade 8 and 12 tests, organized by Domain is presented in Figure 6~7» 

Sodjp'.very clear patterns o&^performance are illustrated in Figure 6-7, 
The MatlT 12 group, as would be/nope3, performed well on all three* domains 
and averaged more than eighj^jeen percent* higher* than the next highest group. 
The Math 11 group's perfprmance was in thfe middle, eighteen percent below 
Math 12 and fourteen percent above the l,ower two groups! The most signifi- 
cant pattern in Ffgure 6-7, however, is that the Math IBL group's performance 
was no higher than the Math 8 group's performance. ' • 




:ake 
elected 



The re^'lative, posit ion of^Iath 10, MatH 11, and Math 12 among tti^ three 
groups is not surprising. The* Math 12 gi;?femp should be the best of 
three since the group consists of those students who have elected tj 
mathematics every year. ."^^^The Math ]^ group includes students 

to tak^ one more mathematics course than is required for secoi^ary school ^ 
graduation. The Math 10 students have either decided to take no more mathe- 
matics than is required, or have been incapafble of continuing beyond the 
minimum level required for graduation. v IfjUT^T H B 
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Asked about their future plans, the response category most commonly 
selected by the Math 10 group was "Look for a job".. As the students in 
the Math 10' group seek employment, they are assumed to haye certain skills 

' as graduates of the school system. Among those skills is a mastery of the 

essential skills of mathematics. Society's judgment of their level of 
'mastery of those skills is ^delayed until the students enter tjie job market 
upon graduation from secondary school. If it can be assumed .that the 
judgment is based, in part, on skills learned during grades 9 and 10 and 

^ , that the desired level is higher than the" sixty percent level of actual 
performance, then it should be a matter of some concern that, upon gradua- 
tion, the Math 10 group's performance is no higher than that of the Math 8" 

^ group. . \ 4 * 

Based upon results described in this chapter several recommendations 
are presented. Many recommendations have been made in'Chapter .4 for the 
Grade 8 group and in Chapter 5 for the 6iade 12 .group. 



Re conmendati on^S-l : Secondary mathematics ^teachers should work to improve 
Hhe Math 8^ Math 10^ ^and Math II studSnts^ performance on the use of 
algorithms for rational numbers: the four basic operations with fractions 
the four basic operations with decimals ^ and equLpvalent forms of rational 
numbers. ^ 

•> 

Recommendation 6-2 : ^each^rs of mathematics^ curriculum c^velopere^ and 
teacher educators should co-operate in starting botJi pre- service and in- 
service efforts to ensile that all students receive proper instruction in 
all the facets of the metric system of measurement needed to be^a function-* 
i^g member of Canadian society.-^ . • 

Recommendcction 6-3 : Curriculum developers and secondJjiry mathematics teachers 
should ensure that the basic formulas for area an(Tl7olume are presented to 
ana^^derstood by-- all students. 

\ ' ^ . ' \ 
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* *• SCHOOLS OF THE PILOT TESTING - 

The authors of this report are very grateful to the'-adm1iiistr^tor^ 
staff of the following schools which paVticipated in piloting thp^ 
student tests in the autumn of -igys, • . ' 

Grade 4 Piloting . . ' ^ 

Douglas Road ELementary, Burnaby School' District - 

HillcresfElefTientary , Cqquitlam School 'D.istrict . 

King Geopge V Elementary, Prince George School District 

Lakeview Elementary, Burnaby School district- ' : ' 

MacDonald Eleir:entary , Vancouver School District 

Muriel Baxter. EJementary, Cranbrook School District 

Sir VJIlliam Van Home Elementary, Vancouver School District 



Grade^ 8 Piloting • ; ^ . ^ * ' 

Alpha Secondary, Burnaby Schbol Distri-ot 

Connaught Junior Secondary^ Prince George School D^stj^ncT', 

Gladstone Secondary, Vancou^ver School District- \ 

H^ndswortii Secondary, North* Vancouver^SchooKDi^striet 

Kitsilano Secondary,- Vancouver School District'' 

Laurie Ounior^Secondary CrahbVook^ SchotiU District ' ■ > 

Mary Hill Junior Secondary ; Coqurt lam School District 



, Grade 12 Pilo ting" 

'Alpha Sec^^dary, Burnaby School Dtstrvct / ^ i 
GUdstORe Secondary,' Van<fauver School ' District, . 
H'andswc/rth Secondary, Ncij^h Vancouver School^ Dis^trict 
Kelly 4?oad Secondary, Prince George SthoDl. Di strict . 
Kitsijano 'Secondary-, Vancouver School D^'slrict 
MotiMit" Baker Secondary Cranbrook ScHool OVstrict 
Port Moody Senior Secondary, CoqojjJLlam School District 



> 
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Review ^panels oompr^ised of, *edu^^ori and members of the lay public were organ- 
ized in,,the autuiim of 1976 at rc^^-prov^^nciai Cerrtres lo examine and amend tfia 
pr9pose'd' objectives of the mathematics^ssassiuent before the student tests were 
devefo|>ed. 



- CASTLEGAR REVFEW PANEL " ' 

^ Mr. Jack Allen; SupervisoK 
' Cranbrook School District \ 

Mr. Larry Cerny, Tea,cher - ^ - J 
Fernie SCbool Dis-tricjt ; \^ > — 

J Ms\ -Shen 1 elytra ne, TeacheV ^ 
ArroH Lakes> School District^ 

" Mr. 'Jack Edson, Teacher I 
Nfelson School District , 

Mr. Dale^Fi.ke, Personn^r CTf f i cer . 
Cominco, Trail 

Mr'.- Bruce Gerrard,^ Teacher 
Castjlegar School District 

Mr. Tom Gougeon , .Teacher 

Castlegar 'School District * r . , 

, , Mr. Tom Johnson, T,e'acher 

Nelson School Distr.ict ^ 

Ms. Joan . Know I es , T-eaCHeY 
^ CastTegar Scho51 District 

, Mr.* Peter Makiev, Teacher 
Nelson School District 

• Mr. Gary M^tchel I , Treacher. 
Cranbrook Schoo] District ' 

Mr. Bruce. Morrison , Teaclj^r ^ 
Arrow Latces Sch-oal District . 

Mr. Sebastian Nutini^.; Supervisor 
Trail Sixhoo'l District 

Mr. Frank, PerefK(doff , Teacher 
' Castlegap^ 'School ^District 

"^"Mrs. Jean Ryley, Primary Co-Ordinator 
Cra'nbrool^ Schoo'l District 

Mr. Dan.Shimizu, Teacher 
Tratl School- Di strict 

Mr. Mao Sinclair/ Selkirk 
Community College, Castlegar 

Mr. Satoshi |chida, Teacher 
Castlegar Saiool DisJi^^ct 

Mrs. Adel'e\ule, tfbmemak^r 
y Castlegar 
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, RICtif^OND>^E\ qEli P ANEL . ^ 

Mr. Dominic Alvaro, Teacher. * 
Nd]^h;^Vancouver School Do's.triqt 

Mr.Veter Beugger, Elementary 
Consultartt., North Vancouver School 
District 

Mr.. Robert Campbell, Teacher 
Richmond S,chool District 

Ms. Evelyn Grimston, Teacher 
Burnaby School District 

Mr. Don He'ise, Teacher 
Burnaby School District 

Mr. Henry Oanzen^ Teacher 
"Delta School District 

* 

Mr. Ted'Kagetsu, Teacher 
'Richmond School .Distr>ict. 

Mrs. Madeline Noble^^ School Board 
M^ber, Richmond School District 

-Ms. Linda 0' Rei 1 ly , ' Teacher - 
•V^coJvfr School District' 

Mr. 'G^rr/ Phillips , Teacher 
NeW^Westminster School District 



Mr. Berrti« ^Pregler,,* Continuing .Education 
Administra^tor/Coqui tlam 'Schoo] Di strict 

Mr, Dave Rivers, Eiiucation- Services - ^ 
Off icer,, British .Ccrlumbia ^hool >' / 
Trustees Association ,<i^ancouver * . 



^Ms.| Pat Takasaki, Teacfher^ 
Richmond School Distrinrt 

Mr. *Alan Tayjor, Teacher 
Coquitlam Sch'ool Pistrrct 

Mr. R. Bruce Wood, Teacher 
Vancouver School District 
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HANEY REVIEW PANEL 



0 




Mr, Ken Abrainson,^ Teacher 

♦ Chilliwack School D,istrict^ ' * 

Mrs. Mary Ammerlaan, School Aide 
Maijle Ridge * ' 

Mr/ JYAll^s.tair TJrownv Chartered- \ 
Acco^'untant , Map;le -Riidge^ - % \ 

Mrs. Helen^'Casher, ^choot Board /) 
Member, Maple Ridge^ School Djstritt 

Mr. Mike Cianci^ Teacher ' 
Kami oops Schoo-1 District 

Mr. Richard Collins, Teacher ^ 
Cpquitl am School District " ^ 

'Mr. Jam^ Connor, Supervisor 
Maple Rid^e School District 

Mr.. Nevi^lli Cox, SchaoT'Bo.ard 
c /^embQr, Miss'ioh School District 

Mr. Alan Davies, Teach#^ . 
CoquitlamB.chodl •District 

Mrs. Gracfe Dilley, Curriculum 
Advisory Surrey 'School District' 

•Mr. George 'Eldridge, Teactier 
Kajnloops Schpql" Distr^t.> 

. Mr=w Len Fowles, Principal 
/ •K.amloopS^ -School" District 

Mr. ' Roger f rifschi , Teacher 

• Co^Juj^tlam s/hoojlDistrict 

Mr. Ra^pi) gardn'e'r ^.-Superviso^r - 
' Coc|u1tlam Schoc\ District 

- Mr.^Kiyo^ Haifede,'^eacKer - ^ 
Langley School District . ^ * 

'Mrs. Lynda Hay low, Homemaker 

Maple Ridge . , , ' , 

• * "* 

, Mr. .Retgr^ l^erop.atntc'k. Teacher 
. Chill'twack SchopVDi^trict- . 

Mr:- Roy Kuri ta,. Teache'r. . • 
Surrey Schoql 'Dis^^vici: 

Mrs. OzarJ" McSWeen^y , Teacher^ ^ 
..ChiVliwack School Distrjd^t - 

Mrs. Matron JiJus sal em" . ' 
-Homenn^k.^r, Mapljs" R.iage 

Mrs: f^ry Wright, .Teacher 
Ungley School District \ 



. VICTORIA miEW PANEL . ' 
% ^^-^^^^ ,q — 

Mr. -George Atamanenko, Town . 
• ^ Planner, Victoria . ^ 

^ Mrs. Jean/Barnes, Teacher- 
Gulf Islarfds School District 

• Dr.- William Bloomberg, Forest 
Chemist, Victoria ^ • 

Mr, ^ Geoff Bopth, Teacher 
Nanaimo School District 

. '^Mrs, Kir-sten Cox, Teacher 
^Qi/al-icum School District _ 

Mr. WiTJ^iam Dale, Teacher - 
' Qualicum' School District 

^Mr. John Epp, T'eaeher 

' < 'Sooke School District 
f ' . ' ' 

/Mr., David HaVris , TeacheV. 
'I Victoria School District 



J)r. 
Kemb 




r 



& Knight, School Board ^ ^ 
Victoria* School District 

Mrs^ Helga L|nke,^'School Boar.d . 
.>%!iber, Lake|Cow.iQhaf>-School' District 

Mrs. RQsemari^ Lc^e^' feaChqr ^' '\ 
Sooke School District. . . 

>1r.. DaryVMcIntyrer Principal > ' > ^ 
^ Sooke School •Distri(^t 

. Mrs, 'Betty Morphet, Teacher 

* Lake Cow^chan School' District 

Mrs. Margaret ^^elson', Homemaker 
Victoria ' ^ 

Mr. Arthur Olson, Principal 
Qualicum School -District ' "* 

Ms* <inda O'Reilly, Teacher 
Vancouver' School District 

Mrs. Margaret Str£>ngithann Jeacher , 
Nanaimo School District . « 

^ Mr. .Brian Tetlcfc^ Teacher ' ^ ^ 
Victorta SctoorDistj^ct ' " ' ^ 

l5ir.^.J?mes V^nc^, Faculty of Education- 

* University of Victoria ' . " 

-1:. ■.\ ■ . 
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" Review Panel with -the Mathematic s Revisi^on Committee 

In Octpbe/of 1976, the Contract Team met with the following members of .the 
Mathematics Revision Committee to obtain their opinions on, the proposed 
desi gn' of tbe ma themcLtics^ assessment: , - 

J^^James Bourdon, Supervisor, North Vancouver SchooT District 

Mr. Ron^14 Edmonds, Teacher, Victoria School District ' 'A 

Hr*. Ea^iJ";], Johrmi^ Teacher, Vancouver 'Scjiool District^; 

Mr. Stan fleiEi;:tie^cfjer\,. Courtenay School Distri'ct ' . 

Dr. Elizabeth ICBfyieily, Fac,U^^' of Arts *& Science, University of Victoria 

Mr. William/ KokoskJr^^*T|aeher/ 

Mr. George .NachtT^al, Teacher^ Abbotsford SCfiooT Di^tript ' * 

Mr. Wjllard Dunlop, Gonsultant, Curiricu^um develapfpent. B-rancji, Ministry of 
Education / I ^ \ . • \ . , 
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•INT^PRETATION P9\NELS. 



The fallowing three panels contributed to the interpretation of test resul^ts by 
rating the pupil performante on each item. 



^ Grade '4 Test Interpretation Panel 



Mr. Oa^k Allen, Supervisor, Cranbroolc Scho61 District . <t 
Mr. James Bourdon, Supervisor* North Vancouver. School District 
Mrs. Jacquie Boyer, School Board^ Member, Coquitlam School District 
Mrs. Grac^ 5iil ley. Curriculum Advisor, Surrey Scjiool District 
Miss Evelwdrimston, Teacher, Burnaby Sobool District 
yM'rs. Jean Han, Homemaker, Vdi^couver ^ /V • - - ^ 

Mrs. Helen M&cDonald, School Board Membef^/fVission School District 
Miss Pat/^WtgOTiery , Teacher, Vancouv.er Scnool District 
Miss Pat'Peh^r, Teaqher,' Vancouver School District 
Mr. Ed P^chmond., Faculty of Education, University of. Victoria , 
>irs. A^ine^Robarts, Teaclier, VancDliver School . District * ( . 

Mrs> Shirley/ Rudolph, Teacher; Vancouver School District * 
Ms. Pat Takasaki, Teacher, -Richmond -School District ^ ^ 

Dr. John Trivett, Faculty of Educatii:)n, Simon Eraser University 
Mrs. J. L. Wisenthal Homemaker , Vancouver 

Grade 8 fest Interpretation Panel ^ / ' 

Dr. Irving Burbank, Faculty of Educ^ati-on, University of V.ictoria 
Mr. -Roberti Campbell ,. Teacher, Richmond School District 
Mr. Ricjiard Collins, TeaCfier, Cotjiiitlam-Schbol District - ' . 
Mrs. Ishbel Elliott, School Board Member, Ricfjfnondv^choo'l Distwct 
.Mrs. Barbara Girling^^SchooTfepard Member, S^ifrey* SchooYOistnic^:* / 
Don-Heise,.Jeacher,' Bur/iaby School pis^trict ^ . ' 

Henry Janzen, ^leacher, DeVta School Districl'* , . ^ 

^William Ko^oskin, Teacher, Nijcth Vancouver School, District , » 

r M. Mussalem, Homemaker, ^a/le Ridge > \ ' 
Tomo|-Naka, Principal , Nel-SOR- School Di_strict 

Sebastian Nutini, Supervisor, Trail' School District - ^ . ^ 

"douglas Orvens, Faculty of Educatiprr^ University of British Columbia 
Thomas Poulton, Teacher, Del ta School District * 
Brian Tetlow, Teacher, v/ctSria School District . " > * 
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Grade 12 Test. Interpretation Panel 



Mr. 
Dr. 
M>. 

Mr. 
. Mr". 
Mr. 
W. 
-Or 
Mrs 
"Mr 
Mn, 
Mr 
Mrs 



Dominic* ^varo, Teapher, North Vancouver School Djstri 
Thomas Bates, Faculty of Education-, University-of British. Columbia 
Peter Bens<p, Director of Education., Institute of Chartered Accounta.ntS , 
North Vai^couyer . , . • , - . " • . ■ • _ 

'-N|yillp;Cox, School Board Member, Missiop "School Distr*ic't ' - 
Michael Dov«Kiing, Supervisor, "West Vancouver School District - . .? " " 
John Epp, Teacher, Sea^e School District . . '% ' ' " 

Ian Hopper, Teacjier, Vancouver School District ; ■ .• 

Home, Faculty' of Education, Uni^er?tty of Victdria - ' . ' 

ne -McKendrick, School Board Member, PowelVRiVer School District " 
Fr\an"k Perehudpff, Tekher,- Castlegar School District 

Bef-nie Pregler, Continuing Education Administrator, Coquitlam Scho_^l District 
Mel RichaN-ds", Principal , 'Richmon4 School District 
Ona Mae Roys President, B^ G.^Home & School 'Federation,' Port Moody 




Mr. .Alan Jaytor, Teacher, Coqui^b+im School District 
^j"-. R. Bruce Wo6d, Teacher, Vancouver School Dfstrict 
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